KSA Assessment Design & Evaluation Methods 5

Question 1

Under the Uniform Guidelines on Employee Selection Procedures (1978), adverse impact is generally indicated when the selection rate for a protected group is less than what fraction of the highest-scoring group?

Accepted Answer

Four-fifths (80%)

Answer

The four-fifths (80%) rule in the Uniform Guidelines defines adverse impact as a selection rate for a protected group less than 80% of the rate for the group with the highest selection rate.

Question 2

A test with high specificity but low sensitivity in a selection context would:

Accepted Answer

Correctly reject unqualified candidates but miss many qualified ones

Answer

High specificity means the test rarely selects unqualified candidates (low false positives), but low sensitivity means it rejects many truly qualified candidates (high false negatives).

Question 3

The ADDIE model's 'Analysis' phase in assessment development primarily involves:

Accepted Answer

Identifying performance gaps, learner characteristics, and required KSAs

Answer

The Analysis phase defines the performance gap, target audience, and required KSAs that the assessment must address before any design work begins.

Question 4

Which type of rating scale requires raters to allocate a fixed percentage of employees into performance categories, preventing all employees from receiving the highest rating?

Accepted Answer

Forced distribution

Answer

Forced distribution mandates that ratings follow a predetermined curve (e.g., top 10%, middle 70%, bottom 20%), preventing rating inflation.

Question 5

A KSA assessor is reviewing a written knowledge test and notices that item stems are ambiguous and answer choices overlap. This most directly threatens:

Accepted Answer

Content and construct validity

Answer

Ambiguous stems and overlapping options introduce construct-irrelevant variance, undermining both content validity (unclear what is being measured) and construct validity (adding unintended factors like reading ambiguity).

(KSA) Certified Knowledge, Skills, and Abilities Assessor Practice Test

(KSA) Certified Knowledge, Skills, and Abilities Assessor Practice Test

KSA Assessment Design & Evaluation Methods 5