ATP Research & Evidence-Based Practice 2

Question 1

Which statistical concept describes the degree to which a test score reflects true ability rather than measurement error?

Accepted Answer

Reliability coefficient

Answer

The reliability coefficient quantifies the proportion of observed score variance attributable to true score variance, directly reflecting measurement precision.

Question 2

In Item Response Theory, the 'b' parameter of a dichotomous item represents:

Accepted Answer

Item difficulty (location)

Answer

The b parameter in IRT is the difficulty or location parameter, indicating the ability level at which a test-taker has a 50% probability of answering correctly (in the 1PL/2PL models).

Question 3

A researcher finds that exam scores predict job performance equally well for male and female applicants. This demonstrates:

Accepted Answer

Predictive bias absence

Answer

When regression lines for predicting a criterion from test scores do not differ significantly across subgroups, the test shows no predictive bias.

Question 4

Which research design provides the strongest evidence for causal inference in educational testing?

Accepted Answer

Randomized controlled trial

Answer

Randomized controlled trials allow causal conclusions because random assignment controls for confounding variables.

Question 5

The Standards for Educational and Psychological Testing defines 'consequential validity' as primarily concerned with:

Accepted Answer

Intended and unintended social consequences of test use

Answer

Consequential validity examines the value implications and social consequences—both intended and unintended—that result from test score interpretations and uses.

ATP - Association of Test Publishers Practice Test

ATP - Association of Test Publishers Practice Test

ATP Research & Evidence-Based Practice 2