KSA Assessment Design & Evaluation Methods 4

Question 1

Which scale of measurement allows for meaningful calculation of ratios between scores?

Accepted Answer

Ratio

Answer

Ratio scales have a true zero point, making it meaningful to say one score is twice another, unlike interval scales which lack a true zero.

Question 2

A KSA assessor notices an assessment consistently produces scores 10 points higher than a validated benchmark tool. This is an example of:

Accepted Answer

Systematic error (bias)

Answer

Systematic error (bias) causes scores to consistently deviate in one direction from the true score, unlike random error which fluctuates unpredictably.

Question 3

The three-parameter logistic (3PL) model in Item Response Theory adds which parameter compared to the 1PL (Rasch) model?

Accepted Answer

Guessing (pseudo-chance level)

Answer

The 3PL model extends the 1PL by adding a discrimination parameter and a pseudo-guessing parameter (c) that accounts for the probability of low-ability examinees answering correctly by chance.

Question 4

A work sample test requires candidates to perform tasks that directly replicate key job duties. Its primary advantage is:

Accepted Answer

High fidelity and content validity

Answer

Work sample tests have high content validity because they closely mirror actual job tasks, increasing both predictive validity and candidate acceptance.

Question 5

Which type of validation study compares test scores to performance measures collected at the same time from current employees?

Accepted Answer

Concurrent validity study

Answer

A concurrent validity study collects both predictor and criterion data simultaneously from a current workforce, making it faster but more vulnerable to range restriction.

(KSA) Certified Knowledge, Skills, and Abilities Assessor Practice Test

(KSA) Certified Knowledge, Skills, and Abilities Assessor Practice Test

KSA Assessment Design & Evaluation Methods 4