KSA Psychometric Testing & Measurement Theory 2

Question 1

Which Item Response Theory (IRT) model uses only item difficulty to characterize test items?

Accepted Answer

1-parameter logistic model (Rasch model)

Answer

The Rasch (1PL) model characterizes items using only the difficulty parameter, assuming all items discriminate equally.

Question 2

Differential Item Functioning (DIF) analysis is conducted primarily to:

Accepted Answer

Identify items that perform differently for subgroups of equal ability

Answer

DIF analysis detects items where examinees from different subgroups with the same ability level have systematically different probabilities of responding correctly.

Question 3

A norm-referenced assessment interprets an individual's score by comparing it to:

Accepted Answer

The performance of a relevant comparison group

Answer

Norm-referenced assessments rank individuals relative to a normative sample, indicating where a person falls in the distribution of scores.

Question 4

In a criterion-referenced assessment, a cut score is established to:

Accepted Answer

Determine who meets a minimum performance standard

Answer

A cut score defines the minimum level of performance required to be classified as competent or passing on a criterion-referenced assessment.

Question 5

Which method of setting a cut score asks subject matter experts to estimate the probability that a minimally competent candidate would answer each item correctly?

Accepted Answer

Angoff method

Answer

The Angoff method has SMEs estimate the probability that a minimally competent examinee would answer each item correctly; these probabilities are averaged to set the cut score.

(KSA) Certified Knowledge, Skills, and Abilities Assessor Practice Test

(KSA) Certified Knowledge, Skills, and Abilities Assessor Practice Test

KSA Psychometric Testing & Measurement Theory 2