CTP Evaluation & Measurement of Training Effectiveness 5 — Questions and Answers
Question 1: Which approach involves converting intangible training benefits—such as improved teamwork—into monetary values using estimates and assumptions?
- Trend line analysis
- Converting intangibles to monetary value (Correct answer)
- Needs assessment
- Criterion-referenced testing
Correct answer: Converting intangibles to monetary value
Some ROI methodologies attempt to convert intangibles to monetary value, though this requires careful estimation and stakeholder agreement on assumptions.
Question 2: A 90-day follow-up survey sent to supervisors asking about changes in employee performance is designed to measure which Kirkpatrick level?
- Level 1
- Level 2
- Level 3 (Correct answer)
- Level 4
Correct answer: Level 3
A follow-up survey to supervisors about employee behavioral changes on the job measures Level 3 (Behavior/Transfer) outcomes.
Question 3: The CIPP evaluation model (Context, Input, Process, Product) is most useful for:
- Calculating ROI of a single training event
- Providing a comprehensive framework for program decision-making at multiple stages (Correct answer)
- Measuring learner satisfaction immediately after training
- Comparing two training programs head-to-head
Correct answer: Providing a comprehensive framework for program decision-making at multiple stages
The CIPP model provides a systems-level evaluation framework used to support decisions at context, input, process, and product stages of a program.
Question 4: What does 'criterion-referenced testing' mean in training evaluation?
- Ranking learners against each other on a bell curve
- Measuring learner performance against a predetermined standard or mastery level (Correct answer)
- Comparing scores across different training cohorts
- Evaluating the trainer's performance criteria
Correct answer: Measuring learner performance against a predetermined standard or mastery level
Criterion-referenced tests measure whether a learner has achieved a specific performance standard, independent of how others performed.
Question 5: Which of the following BEST describes the concept of 'transfer climate' as it relates to training evaluation?
- The temperature and comfort level of the training room
- The degree to which the work environment supports applying learned skills (Correct answer)
- The transfer of evaluation data to HR records
- The learner's motivation to attend training voluntarily
Correct answer: The degree to which the work environment supports applying learned skills
Transfer climate refers to workplace conditions—including supervisor support, peer encouragement, and practice opportunities—that either facilitate or impede on-the-job skill application.
Question 6: A training professional reports that a sales training program produced a 250% ROI. This means:
- The program cost $250 per participant
- For every dollar invested, the program returned $2.50 in net benefits (Correct answer)
- The program generated 250% more revenue than before training
- Total benefits equaled 250% of total company revenue
Correct answer: For every dollar invested, the program returned $2.50 in net benefits
A 250% ROI means the net benefits exceeded costs by 250%, or for every $1 invested, $2.50 in net benefit was returned (net benefit = $2.50 per $1 cost).
Question 7: When a training evaluation report is shared with senior leadership, the MOST important section to include is:
- A complete list of all survey questions used
- The training schedule and facilitator bios
- Business impact data and ROI linked to organizational goals (Correct answer)
- Detailed statistical methodology and confidence intervals
Correct answer: Business impact data and ROI linked to organizational goals
Senior leaders prioritize business outcomes and ROI; technical details should be in appendices while the executive summary focuses on organizational impact.
CTP Evaluation & Measurement of Training Effectiveness 5
Which approach involves converting intangible training benefits—such as improved teamwork—into monetary values using estimates and assumptions?