CT Evaluation Methods 2 — Questions and Answers
Question 1: Which Kirkpatrick model level measures whether trainees can apply what they learned on the job?
- Level 1 – Reaction
- Level 2 – Learning
- Level 3 – Behavior (Correct answer)
- Level 4 – Results
Correct answer: Level 3 – Behavior
Level 3 (Behavior) assesses transfer of learning to actual job performance after training.
Question 2: A trainer wants to measure attitude change in learners after a diversity training session. Which evaluation tool is MOST appropriate?
- Skill demonstration checklist
- Likert-scale survey (Correct answer)
- Multiple-choice post-test
- Return-on-investment calculation
Correct answer: Likert-scale survey
Likert-scale surveys are designed to capture degree of agreement or attitude shifts, making them ideal for attitude measurement.
Question 3: What is the primary purpose of a control group in training evaluation research?
- To provide additional training support
- To compare outcomes against an untrained group (Correct answer)
- To identify high-performing trainees
- To reduce the cost of evaluation
Correct answer: To compare outcomes against an untrained group
A control group consists of participants who did not receive training, allowing comparison to isolate the training's effect.
Question 4: Which evaluation design provides the strongest evidence that training caused performance improvement?
- Post-test only design
- Pre-test/post-test design with no control
- Randomized control group pre-test/post-test design (Correct answer)
- Observational case study
Correct answer: Randomized control group pre-test/post-test design
A randomized control group pre-test/post-test design controls for confounding variables, providing the strongest causal evidence.
Question 5: A trainer discovers that learners scored high on the post-test but showed no behavioral change on the job. Which evaluation level revealed this gap?
- Level 1
- Level 2
- Level 3 (Correct answer)
- Level 4
Correct answer: Level 3
Level 3 (Behavior) evaluates on-the-job transfer, revealing a disconnect between knowledge gain and actual application.
Question 6: When using anecdotal evidence as an evaluation method, a trainer should be aware that it:
- Provides statistically reliable data
- May not represent the experience of all learners (Correct answer)
- Eliminates the need for formal assessments
- Is the most objective evaluation method
Correct answer: May not represent the experience of all learners
Anecdotal evidence reflects individual experiences and may not generalize across all participants, limiting its reliability.
Question 7: Which metric best represents a Level 4 (Results) evaluation outcome for a sales training program?
- Trainee satisfaction scores
- Quiz accuracy on product knowledge
- Percentage increase in quarterly revenue (Correct answer)
- Number of role-plays completed
Correct answer: Percentage increase in quarterly revenue
Level 4 measures organizational results such as revenue, productivity, or quality improvements tied to training.
CT Evaluation Methods 2
Which Kirkpatrick model level measures whether trainees can apply what they learned on the job?