CODESP Test Validation and Reliability 4

Question 1

A test developer applies the Spearman-Brown prophecy formula. What is the primary purpose of this formula?

Accepted Answer

To estimate the reliability of a lengthened or shortened test

Answer

To correct for criterion unreliability

Answer

To assess differential item functioning

Answer

To calculate the standard error of estimate

Question 2

Which scenario best illustrates the problem of criterion contamination?

Accepted Answer

Supervisors know an employee's test score before providing performance ratings

Answer

Supervisors rate employee performance without knowing the employee's test score

Answer

The criterion measure is collected six months after hiring

Answer

Two raters independently score the same work sample

Question 3

In item response theory (IRT), which parameter describes how steeply an item distinguishes between higher and lower ability test takers?

Accepted Answer

The a-parameter (discrimination)

Answer

The b-parameter (difficulty)

Answer

The c-parameter (pseudo-guessing)

Answer

The d-parameter (differential functioning)

Question 4

A selection test shows high validity for a sample of incumbents but poor validity for a sample of applicants. The MOST likely explanation is:

Accepted Answer

Range restriction in the incumbent sample inflated the coefficient

Answer

The test lacks content validity

Answer

The criterion measure is unreliable

Answer

Construct irrelevant variance affected the applicant sample

Question 5

Consequential validity refers to the idea that validation should include evidence about:

Accepted Answer

The intended and unintended social consequences of test use

Answer

Correlation with job performance criteria only

Answer

Whether the test was developed by an internal team or consultants

Answer

The test's face validity as perceived by applicants

Question 6

When a test battery includes both a cognitive ability test and a structured interview, and the two are combined into a total score, this practice is known as:

Accepted Answer

Compensatory combination

Answer

Multiple hurdle selection

Answer

Differential weighting

Answer

Banding

Question 7

A test that consistently measures a construct that is NOT the intended construct is said to have high:

Accepted Answer

Construct-irrelevant variance

Answer

Construct-relevant variance

Answer

Criterion deficiency

Answer

Criterion contamination