Psychometric Testing & Measurement Theory Flashcards

Which type of reliability refers to the consistency of scores produced by the same test administered to the same group on two separate occasions?

Answer: Test-retest reliability

Test-retest reliability measures the stability of scores over time by correlating results from two administrations of the same test.

In classical test theory, which formula expresses the relationship between an observed score, a true score, and measurement error?

Answer: X = T + E

Classical test theory states that an observed score (X) equals the true score (T) plus random error (E): X = T + E.

A KSA assessment that measures what it claims to measure is said to have high:

Answer: Validity

Validity refers to the degree to which an assessment actually measures the construct or attribute it intends to measure.

Which validity type is established by comparing assessment scores against a known, accepted criterion measured at the same time?

Answer: Concurrent validity

Concurrent validity is established when the assessment scores correlate significantly with a criterion measured simultaneously.

Item difficulty (p-value) in a dichotomous item refers to:

Answer: The proportion of respondents who answer the item correctly

Item difficulty (p-value) is calculated as the proportion of test-takers who answered the item correctly, ranging from 0 to 1.

Cronbach's alpha is a measure of:

Answer: Internal consistency reliability

Cronbach's alpha estimates internal consistency by measuring how closely related a set of items are as a group.

The standard error of measurement (SEM) is BEST used to:

Answer: Estimate the range within which a candidate's true score likely falls

The SEM quantifies measurement error and is used to construct a confidence interval around an observed score to estimate where the true score lies.