CODESP Test Validation and Reliability 4

Question 1

A test developer applies the Spearman-Brown prophecy formula. What is the primary purpose of this formula?

Accepted Answer

To estimate the reliability of a lengthened or shortened test

Answer

The Spearman-Brown formula predicts how reliability will change as a function of increasing or decreasing test length.

Question 2

Which scenario best illustrates the problem of criterion contamination?

Accepted Answer

Supervisors know an employee's test score before providing performance ratings

Answer

Criterion contamination occurs when supervisors' knowledge of test scores influences their performance ratings, biasing the criterion.

Question 3

In item response theory (IRT), which parameter describes how steeply an item distinguishes between higher and lower ability test takers?

Accepted Answer

The a-parameter (discrimination)

Answer

The a-parameter in IRT reflects item discrimination — how sharply the item separates individuals with different ability levels.

Question 4

A selection test shows high validity for a sample of incumbents but poor validity for a sample of applicants. The MOST likely explanation is:

Accepted Answer

Range restriction in the incumbent sample inflated the coefficient

Answer

Incumbent samples are often range-restricted because low performers have already left, which can inflate validity coefficients relative to applicant samples.

Question 5

Consequential validity refers to the idea that validation should include evidence about:

Accepted Answer

The intended and unintended social consequences of test use

Answer

Consequential validity (Messick's framework) incorporates evidence about the ethical and social impact of testing decisions.

CODESP - Cooperative Organization for the Development of Employee Selection Procedures Practice Test

CODESP - Cooperative Organization for the Development of Employee Selection Procedures Practice Test

CODESP Test Validation and Reliability 4