Assessment & Evaluation Techniques Flashcards

Which data collection method is MOST appropriate for capturing nuanced learner perceptions about a training program's relevance?

Answer: Focus group interview

Focus groups allow in-depth, open-ended exploration of learner perceptions that quantitative surveys cannot capture.

A training evaluation reveals high Level 2 scores but no change in Level 3 behavior. The MOST likely explanation is:

Answer: Transfer barriers exist in the work environment

When learning occurs but behavior doesn't change, environmental factors such as lack of managerial support or opportunity to practice are usually responsible.

Which term describes the degree to which an assessment consistently produces the same results under the same conditions?

Answer: Reliability

Reliability refers to the consistency and repeatability of an assessment across different administrations or raters.

When evaluating a simulation exercise, which assessment approach BEST captures complex problem-solving ability?

Answer: Holistic scoring rubric

Holistic rubrics evaluate the overall quality of a complex performance rather than isolated subskills.

In the Phillips ROI Methodology, which step comes AFTER calculating net program benefits?

Answer: Comparing benefits to program costs

After calculating net benefits (benefits minus costs), the ROI percentage is calculated by dividing net benefits by costs.

A trainer uses the same test before and after instruction to calculate learning gain. This design is called a:

Answer: Pre-test/post-test design

A pre-test/post-test design measures the difference in scores before and after instruction to quantify learning gain.

Which of the following is an example of an unobtrusive measure in training evaluation?

Answer: Reviewing production error rates from existing records

Unobtrusive measures use existing organizational data without requiring learners to respond directly to an instrument.