CET Measurement, Evaluation & ROI of Experiential Programs 1 — Questions and Answers
Question 1: Which evaluation model is most widely used to measure the effectiveness of experiential learning programs across four levels: reaction, learning, behavior, and results?
- Brinkerhoff's Success Case Method
- Kirkpatrick's Four-Level Model (Correct answer)
- Phillips ROI Methodology
- CIPP Evaluation Model
Correct answer: Kirkpatrick's Four-Level Model
Kirkpatrick's Four-Level Model evaluates training effectiveness at the reaction, learning, behavior, and results levels, making it the most widely applied framework in experiential program evaluation.
Question 2: When calculating Return on Investment (ROI) for an experiential program, which formula is used?
- ROI = (Benefits / Costs) × 100
- ROI = ((Benefits - Costs) / Costs) × 100 (Correct answer)
- ROI = (Net Revenue - Program Costs) / Participants
- ROI = (Benefits - Costs) / Benefits × 100
Correct answer: ROI = ((Benefits - Costs) / Costs) × 100
ROI is calculated as net program benefits minus costs, divided by costs, then multiplied by 100 to express as a percentage.
Question 3: A facilitator wants to measure behavioral transfer 90 days after an experiential leadership retreat. Which data collection method is most appropriate?
- Post-event satisfaction survey
- Pre-event knowledge assessment
- 360-degree feedback from direct reports and managers (Correct answer)
- In-event skills demonstration checklist
Correct answer: 360-degree feedback from direct reports and managers
360-degree feedback collected from colleagues and managers 90 days post-event measures whether behavioral change from experiential learning has actually transferred to the workplace.
Question 4: Which level of Kirkpatrick's model is the most challenging to measure in experiential programs?
- Level 1 – Reaction
- Level 2 – Learning
- Level 3 – Behavior
- Level 4 – Results (Correct answer)
Correct answer: Level 4 – Results
Level 4 (Results) is hardest to measure because isolating the business impact of an experiential program from other organizational variables requires rigorous methodology and longitudinal data.
Question 5: What is a 'control group' used for in the evaluation of experiential programs?
- To limit the number of participants per session
- To compare outcomes between participants and non-participants to isolate program impact (Correct answer)
- To control facilitator behavior during activities
- To set budget ceilings for program expenditures
Correct answer: To compare outcomes between participants and non-participants to isolate program impact
A control group of non-participants allows evaluators to compare results and isolate the impact of the experiential program from other variables.
Question 6: Which of the following is an example of a 'leading indicator' in measuring experiential program success?
- Annual employee retention rate
- Team productivity scores measured six months post-program
- Participant engagement scores captured during the event (Correct answer)
- Quarterly revenue attributed to trained teams
Correct answer: Participant engagement scores captured during the event
Leading indicators, such as in-event engagement scores, predict future outcomes and are measured during or immediately after the program rather than months later.
Question 7: When reporting program ROI to a corporate client, which intangible benefit is most important to acknowledge even though it cannot be easily monetized?
- Catering costs saved by in-house venues
- Improved team cohesion and psychological safety (Correct answer)
- Number of breakout sessions completed
- Facilitator travel expenses
Correct answer: Improved team cohesion and psychological safety
Improved team cohesion and psychological safety are critical intangible benefits that drive long-term performance but resist direct financial quantification.
CET Measurement, Evaluation & ROI of Experiential Programs 1
Which evaluation model is most widely used to measure the effectiveness of experiential learning programs across four levels: reaction, learning, behavior, and results?