ETS Validity and Reliability 3

Question 1

Cronbach's alpha is most appropriate for tests where items are scored:

Accepted Answer

On a polytomous (multi-point) scale

Answer

Cronbach's alpha generalizes KR-20 to items with more than two score categories, such as Likert-scale responses.

Question 2

A validity coefficient of r = 0.40 between an entrance exam and GPA is considered:

Accepted Answer

Moderate and practically useful for selection decisions

Answer

In educational and employment testing, validity coefficients around 0.30–0.50 are considered moderate and practically useful.

Question 3

Which of the following would BEST demonstrate discriminant validity?

Accepted Answer

A new anxiety scale correlates low with an unrelated measure like shoe size

Answer

Discriminant validity is supported when a measure does NOT correlate strongly with measures of unrelated constructs.

Question 4

The Spearman-Brown formula is used to:

Accepted Answer

Correct a split-half reliability estimate for test length

Answer

The Spearman-Brown prophecy formula corrects a split-half correlation (based on half the test) to estimate reliability for the full test length.

Question 5

A test developer wants to ensure a reading test covers all major subskills of reading comprehension. This concern relates to:

Accepted Answer

Content validity

Answer

Content validity reflects whether test items adequately and representatively sample the domain of skills or knowledge the test intends to measure.

(ETS) Educational Testing Service Practice Test