Assessment & Evaluation Methods Flashcards

When designing a criterion-referenced test, the passing score is based on:

Answer: A predetermined performance standard

Criterion-referenced tests measure performance against a fixed standard, not relative to other learners.

A trainer notices that one question on a quiz was answered incorrectly by almost every learner who otherwise scored high. This suggests the question may have a problem with:

Answer: Item discrimination

Item discrimination measures how well a question differentiates between high and low performers; a poor discriminating item fails to do this.

Which Kirkpatrick level is typically considered the most difficult to measure?

Answer: Level 4 – Results

Level 4 (Results) is hardest to measure because isolating training's contribution to business outcomes from other variables is complex.

A 'smile sheet' is an informal term for a:

Answer: Post-training reaction questionnaire

A 'smile sheet' is a colloquial name for a Level 1 reaction survey typically completed immediately after training.

An assessment that measures what it is designed to measure is said to have:

Answer: Validity

Validity is the degree to which an assessment accurately measures the intended knowledge, skill, or behavior.

During a skills demonstration assessment, two different evaluators score the same performance differently. This indicates a lack of:

Answer: Inter-rater reliability

Inter-rater reliability refers to the consistency of scores when different evaluators assess the same performance.

In training evaluation, 'isolating the effects of training' means:

Answer: Identifying how much of a performance change is attributable to training versus other factors

Isolating training's effects helps evaluators attribute performance improvements specifically to the training program rather than external influences.