CTP Evaluation & Measurement of Training Effectiveness 2 — Questions and Answers
Question 1: A training manager wants to determine if a new safety training program reduced workplace accidents. Which Kirkpatrick level addresses this outcome?
- Level 1 – Reaction
- Level 2 – Learning
- Level 3 – Behavior
- Level 4 – Results (Correct answer)
Correct answer: Level 4 – Results
Level 4 (Results) measures organizational outcomes such as reduced accidents, costs, or error rates.
Question 2: Which data collection method is BEST suited for capturing nuanced learner perceptions that a survey cannot reveal?
- Post-test scores
- Focus groups (Correct answer)
- Observation checklists
- Learning management system reports
Correct answer: Focus groups
Focus groups allow trainers to probe deeper into learner perceptions and experiences through open dialogue.
Question 3: A Level 2 evaluation should be conducted:
- Six months after training to assess retention
- Immediately before training only
- During and/or immediately after training (Correct answer)
- Only if Level 1 scores are high
Correct answer: During and/or immediately after training
Level 2 evaluations measure knowledge and skill acquisition and are administered during or right after training.
Question 4: When calculating ROI for a training program, the formula used is:
- (Benefits – Costs) / Costs × 100 (Correct answer)
- Benefits / Training Hours × 100
- Costs / Benefits × 100
- (Participants × Score Gain) / Costs
Correct answer: (Benefits – Costs) / Costs × 100
ROI = [(Net Benefits – Program Costs) / Program Costs] × 100, as defined by the Phillips ROI Methodology.
Question 5: Which term describes the process of separating the effects of training from other factors that may have influenced performance improvement?
- Needs assessment
- Isolating the effects of training (Correct answer)
- Summative evaluation
- Benchmarking
Correct answer: Isolating the effects of training
Isolating the effects of training is a key step in ROI analysis to attribute performance gains specifically to the training intervention.
Question 6: A training department uses a control group that receives no training while another group does. This is an example of:
- Formative evaluation
- A quasi-experimental design (Correct answer)
- Needs analysis triangulation
- A summative benchmark
Correct answer: A quasi-experimental design
A quasi-experimental design uses control and treatment groups but without full random assignment, which is common in workplace training evaluations.
Question 7: Which of the following is the primary limitation of using smile sheets (Level 1 evaluations) as the sole measure of training effectiveness?
- They are too expensive to administer
- They measure satisfaction, not learning or performance (Correct answer)
- They cannot be administered anonymously
- They require statistical expertise to analyze
Correct answer: They measure satisfaction, not learning or performance
Smile sheets capture learner reactions and satisfaction, which do not necessarily correlate with actual learning or behavior change.
CTP Evaluation & Measurement of Training Effectiveness 2
A training manager wants to determine if a new safety training program reduced workplace accidents.
Which Kirkpatrick level addresses this outcome?