ETS Standardized Test Design 3

Question 1

Which approach to standard-setting asks panelists to estimate the probability that a 'minimally competent' candidate would answer each item correctly?

Accepted Answer

Angoff method

Answer

The Angoff method asks panelists to estimate the proportion of minimally competent candidates who would answer each item correctly, and those estimates are averaged to set the cut score.

Question 2

When a test measures a single underlying construct, it is said to demonstrate:

Accepted Answer

Unidimensionality

Answer

Unidimensionality means that performance on test items is primarily driven by one latent trait, which is a key assumption of many IRT models.

Question 3

A 'speeded test' is one in which:

Accepted Answer

Time limits prevent many examinees from attempting all items

Answer

In a speeded test, the time limit is a major factor—examinees who work more quickly will attempt and complete more items, affecting score interpretation.

Question 4

Which measure of reliability estimates consistency across two different forms of the same test given simultaneously?

Accepted Answer

Alternate-forms reliability

Answer

Alternate-forms reliability (parallel-forms reliability) assesses consistency between two equivalent test forms administered in close succession.

Question 5

In a norm-referenced test, a student's score is interpreted by:

Accepted Answer

Ranking performance relative to a defined reference group

Answer

Norm-referenced interpretation compares an examinee's score to the performance of a normative sample, typically expressed as percentile ranks or standard scores.

(ETS) Educational Testing Service Practice Test

(ETS) Educational Testing Service Practice Test

ETS Standardized Test Design 3