KSA Assessment Design & Evaluation Methods 2

Question 1

Which evaluation model emphasizes the use of goals-free evaluation to avoid bias toward intended outcomes?

Accepted Answer

Scriven's Goal-Free Evaluation

Answer

Scriven's Goal-Free Evaluation assesses actual effects without being anchored to the program's stated goals, reducing evaluator bias.

Question 2

A KSA assessor needs to determine if a selection test is measuring the intended construct. Which validity type is most relevant?

Accepted Answer

Construct validity

Answer

Construct validity confirms that an assessment actually measures the underlying theoretical construct it is designed to measure.

Question 3

In criterion-referenced assessment, a passing score is set by:

Accepted Answer

A predetermined standard linked to job performance

Answer

Criterion-referenced assessments use a fixed performance standard tied to job requirements rather than comparing candidates to each other.

Question 4

Which item format is most susceptible to test-wiseness, where examinees can identify the correct answer without content knowledge?

Accepted Answer

Multiple choice

Answer

Multiple-choice items are vulnerable to test-wiseness strategies like eliminating obviously wrong distractors or recognizing grammatical cues.

Question 5

A Delphi method is used in assessment development primarily to:

Accepted Answer

Reach expert consensus on KSA definitions or cut scores

Answer

The Delphi method uses structured rounds of expert input and feedback to build consensus on complex judgments like job-relevant competencies or passing standards.

(KSA) Certified Knowledge, Skills, and Abilities Assessor Practice Test

(KSA) Certified Knowledge, Skills, and Abilities Assessor Practice Test

KSA Assessment Design & Evaluation Methods 2