CT Evaluation Methods 4 — Questions and Answers
Question 1: Which component is essential when calculating the Return on Investment (ROI) of a training program?
- Learner satisfaction scores from smile sheets
- Monetary value of performance improvements minus training costs (Correct answer)
- Number of hours spent in training
- Percentage of learners who passed the post-test
Correct answer: Monetary value of performance improvements minus training costs
ROI compares the financial benefits of improved performance against the total cost of delivering the training program.
Question 2: A trainer wants to determine whether improved productivity after training is due to training or another factor like a new software tool. The trainer should use:
- Focus groups with senior managers
- A trend line analysis comparing pre/post periods
- An isolation technique such as a control group or expert estimation (Correct answer)
- A participant satisfaction survey
Correct answer: An isolation technique such as a control group or expert estimation
Isolation techniques — including control groups, trend analysis, or stakeholder estimation — help attribute performance change specifically to training.
Question 3: What does 'transfer of training' refer to in evaluation?
- Moving training records from one system to another
- The degree to which learned skills are applied in the work environment (Correct answer)
- Transferring a trainee to a different learning module
- The handoff of training responsibilities from one trainer to another
Correct answer: The degree to which learned skills are applied in the work environment
Transfer of training measures how effectively new knowledge and skills are applied on the job after training concludes.
Question 4: Which of the following is an example of an unobtrusive evaluation method?
- Administering a written post-test
- Reviewing existing sales records before and after training (Correct answer)
- Conducting a structured interview with trainees
- Distributing a learner reaction survey
Correct answer: Reviewing existing sales records before and after training
Unobtrusive measures use existing data (records, reports, metrics) without requiring participants to do anything additional for evaluation purposes.
Question 5: A training manager wants to compare how different delivery formats (classroom vs. e-learning) affect knowledge gain. The BEST evaluation design for this comparison is:
- Single-group post-test only
- Comparative control group design with pre- and post-tests (Correct answer)
- Anecdotal collection from supervisors
- Level 1 reaction survey
Correct answer: Comparative control group design with pre- and post-tests
A comparative control group design with pre/post-tests allows systematic comparison of outcomes across two delivery methods under controlled conditions.
Question 6: Which type of question on an evaluation instrument is BEST for capturing unexpected learner insights or suggestions?
- True/false questions
- Ranking scales
- Open-ended questions (Correct answer)
- Multiple-choice knowledge checks
Correct answer: Open-ended questions
Open-ended questions allow learners to express thoughts that predetermined response options would miss, capturing richer qualitative feedback.
Question 7: What is a 'smile sheet' in training evaluation, and what is its primary limitation?
- A competency rubric; it is too complex for most trainers
- A post-training reaction survey; it measures satisfaction but not learning or performance (Correct answer)
- A peer feedback form; it lacks confidentiality
- A skills checklist; it only applies to technical training
Correct answer: A post-training reaction survey; it measures satisfaction but not learning or performance
Smile sheets measure immediate learner satisfaction (Level 1) but provide no evidence of whether learning occurred or performance improved.
CT Evaluation Methods 4
Which component is essential when calculating the Return on Investment (ROI) of a training program?