KSA Psychometric Testing & Measurement Theory

Question 1

Which type of reliability refers to the consistency of scores produced by the same test administered to the same group on two separate occasions?

Accepted Answer

Test-retest reliability

Answer

Inter-rater reliability

Answer

Internal consistency reliability

Answer

Parallel forms reliability

Question 2

In classical test theory, which formula expresses the relationship between an observed score, a true score, and measurement error?

Accepted Answer

X = T + E

Answer

X = T - E

Answer

T = X × E

Answer

E = T / X

Question 3

A KSA assessment that measures what it claims to measure is said to have high:

Accepted Answer

Validity

Answer

Reliability

Answer

Standardization

Answer

Norming

Question 4

Which validity type is established by comparing assessment scores against a known, accepted criterion measured at the same time?

Accepted Answer

Concurrent validity

Answer

Predictive validity

Answer

Content validity

Answer

Construct validity

Question 5

Item difficulty (p-value) in a dichotomous item refers to:

Accepted Answer

The proportion of respondents who answer the item correctly

Answer

The probability an item is biased

Answer

The variance of item scores

Answer

The correlation between item score and total score

Question 6

Cronbach's alpha is a measure of:

Accepted Answer

Internal consistency reliability

Answer

Test-retest reliability

Answer

Inter-rater agreement

Answer

Predictive validity

Question 7

The standard error of measurement (SEM) is BEST used to:

Accepted Answer

Estimate the range within which a candidate's true score likely falls

Answer

Identify biased test items

Answer

Compare mean scores across demographic groups

Answer

Calculate the predictive validity coefficient