CODESP Test Validation and Reliability 3

Question 1

A job analysis identifies five critical task clusters for a position. A test that covers only two of those clusters likely lacks:

Accepted Answer

Content validity

Answer

Content validity requires adequate coverage of all critical KSAs and tasks identified in the job analysis.

Question 2

The attenuation of a validity coefficient due to restriction of range refers to:

Accepted Answer

A coefficient that is artificially deflated because the sample lacks score variability

Answer

Range restriction occurs when hired employees represent a narrow band of scores, which deflates observed validity coefficients.

Question 3

Which statistic is most commonly used to assess internal consistency reliability for tests with polytomous (multi-point) items?

Accepted Answer

Cronbach's alpha

Answer

Cronbach's alpha is appropriate for items with multiple response categories, while KR-20 is for dichotomous items.

Question 4

A validity generalization (VG) study concludes that a test has consistent validity across multiple settings. This finding supports:

Accepted Answer

The transportability of test validity to new settings without local studies

Answer

Validity generalization supports using existing validity evidence to infer a test's validity in a new setting without conducting a full local study.

Question 5

When evaluating construct validity, convergent evidence is demonstrated when:

Accepted Answer

The test correlates highly with measures of theoretically similar constructs

Answer

Convergent evidence shows that measures of the same or related constructs correlate substantially with each other.

CODESP - Cooperative Organization for the Development of Employee Selection Procedures Practice Test