KSA Psychometric Testing & Measurement Theory 3

Question 1

Which statistical index, ranging from -1.0 to +1.0, is used to evaluate how well a test item discriminates between high and low scorers?

Accepted Answer

Point-biserial correlation

Answer

Kappa coefficient

Answer

Cronbach's alpha

Answer

Standard error of measurement

Question 2

A test blueprint (also called a test specification table) is used primarily to ensure:

Accepted Answer

Proportional content coverage aligned with the KSA domain

Answer

High internal consistency across all items

Answer

Minimum sample size for norming

Answer

Statistical equivalence between parallel test forms

Question 3

Which type of validity evidence is gathered by examining the relationships between the assessment and external measures of theoretically related and unrelated constructs?

Accepted Answer

Construct validity

Answer

Content validity

Answer

Criterion-related validity

Answer

Face validity

Question 4

Parallel forms reliability (alternate forms reliability) is BEST suited for reducing:

Accepted Answer

Practice effects and item memorization across test administrations

Answer

Rater subjectivity

Answer

Sampling error in small normative groups

Answer

Construct-irrelevant variance

Question 5

In IRT, the item characteristic curve (ICC) depicts the relationship between:

Accepted Answer

A candidate's latent trait level and the probability of a correct response

Answer

Item difficulty and item discrimination

Answer

Total test score and criterion performance

Answer

Item variance and test reliability

Question 6

Which approach to validity emphasizes that validity is a unitary concept where all forms of evidence collectively support the interpretation and use of test scores?

Accepted Answer

Unified validity framework (Messick's framework)

Answer

Trinitarian validity model

Answer

Classical validity framework

Answer

Factorial validity approach

Question 7

When evaluating the psychometric quality of a KSA assessment, a reliability coefficient of 0.90 compared to 0.60 indicates:

Accepted Answer

Lower measurement error and more consistent scores

Answer

Higher measurement error and less consistent scores

Answer

Greater content validity but lower construct validity

Answer

A narrower range of item difficulty values