KSA Psychometric Testing & Measurement Theory 2

Question 1

Which Item Response Theory (IRT) model uses only item difficulty to characterize test items?

Accepted Answer

1-parameter logistic model (Rasch model)

Answer

2-parameter logistic model (2PL)

Answer

3-parameter logistic model (3PL)

Answer

Generalizability theory model

Question 2

Differential Item Functioning (DIF) analysis is conducted primarily to:

Accepted Answer

Identify items that perform differently for subgroups of equal ability

Answer

Increase test reliability coefficients

Answer

Reduce the number of items in a test

Answer

Establish content validity evidence

Question 3

A norm-referenced assessment interprets an individual's score by comparing it to:

Accepted Answer

The performance of a relevant comparison group

Answer

A pre-defined performance standard

Answer

The individual's previous test scores

Answer

The content domain coverage

Question 4

In a criterion-referenced assessment, a cut score is established to:

Accepted Answer

Determine who meets a minimum performance standard

Answer

Rank candidates from highest to lowest

Answer

Identify the mean of the score distribution

Answer

Measure inter-rater reliability

Question 5

Which method of setting a cut score asks subject matter experts to estimate the probability that a minimally competent candidate would answer each item correctly?

Accepted Answer

Angoff method

Answer

Bookmark method

Answer

Contrasting groups method

Answer

Body of Work method

Question 6

Generalizability theory (G-theory) extends classical test theory primarily by:

Accepted Answer

Partitioning observed score variance into multiple sources simultaneously

Answer

Replacing reliability with validity coefficients

Answer

Eliminating the need for a normative sample

Answer

Requiring IRT parameter estimation

Question 7

When a KSA test has high construct validity, it means the test:

Accepted Answer

Accurately measures the theoretical trait or construct it purports to assess

Answer

Covers all content domains proportionally

Answer

Produces consistent scores across administrations

Answer

Predicts future job performance well