KSA Psychometric Testing & Measurement Theory

Question 1

Which type of reliability refers to the consistency of scores produced by the same test administered to the same group on two separate occasions?

Accepted Answer

Test-retest reliability

Answer

Test-retest reliability measures the stability of scores over time by correlating results from two administrations of the same test.

Question 2

In classical test theory, which formula expresses the relationship between an observed score, a true score, and measurement error?

Accepted Answer

X = T + E

Answer

Classical test theory states that an observed score (X) equals the true score (T) plus random error (E): X = T + E.

Question 3

A KSA assessment that measures what it claims to measure is said to have high:

Accepted Answer

Validity

Answer

Validity refers to the degree to which an assessment actually measures the construct or attribute it intends to measure.

Question 4

Which validity type is established by comparing assessment scores against a known, accepted criterion measured at the same time?

Accepted Answer

Concurrent validity

Answer

Concurrent validity is established when the assessment scores correlate significantly with a criterion measured simultaneously.

Question 5

Item difficulty (p-value) in a dichotomous item refers to:

Accepted Answer

The proportion of respondents who answer the item correctly

Answer

Item difficulty (p-value) is calculated as the proportion of test-takers who answered the item correctly, ranging from 0 to 1.

(KSA) Certified Knowledge, Skills, and Abilities Assessor Practice Test