CET Measurement, Evaluation & ROI of Experiential Programs 2 — Questions and Answers
Question 1: In the Phillips ROI Methodology, which step is added beyond Kirkpatrick's four levels?
- Level 0 – Inputs & Indicators
- Level 5 – Return on Investment (ROI %) (Correct answer)
- Level 5 – Participant Satisfaction Index
- Level 5 – Net Promoter Score
Correct answer: Level 5 – Return on Investment (ROI %)
Jack Phillips added a fifth level—ROI%—that converts Level 4 results into a financial return on investment calculation, completing the full impact chain.
Question 2: A client requests a 'needs assessment' before designing an experiential program. What is the PRIMARY purpose of this assessment?
- To determine the event venue and catering budget
- To identify performance gaps and align program objectives with business needs (Correct answer)
- To evaluate participant satisfaction with past programs
- To calculate the projected ROI before program delivery
Correct answer: To identify performance gaps and align program objectives with business needs
A needs assessment identifies the gap between current and desired performance, ensuring the experiential program is designed to address specific organizational needs.
Question 3: Which data collection tool is best suited for capturing quantitative learning gains immediately after an experiential session?
- Focus group debrief
- Pre/post knowledge test (Correct answer)
- Open-ended reflection journal
- Anecdotal facilitator notes
Correct answer: Pre/post knowledge test
A pre/post knowledge test measures the change in participant knowledge before and after the session, providing quantitative evidence of learning gain.
Question 4: What does 'isolating the effects of training' mean in ROI evaluation?
- Keeping program content confidential from non-participants
- Separating the program's contribution to results from other factors like market conditions or management changes (Correct answer)
- Limiting training to isolated breakout groups
- Preventing cross-contamination of control and experimental groups during activities
Correct answer: Separating the program's contribution to results from other factors like market conditions or management changes
Isolating the effects of training means attributing performance improvements specifically to the program rather than to external variables, ensuring accurate impact measurement.
Question 5: Which stakeholder report format best communicates program impact to a C-suite executive who has limited time?
- A 40-page detailed evaluation narrative with appendices
- A one-page executive summary with key metrics, ROI percentage, and business impact highlights (Correct answer)
- A raw data export from participant surveys
- A facilitator debrief transcript
Correct answer: A one-page executive summary with key metrics, ROI percentage, and business impact highlights
Executives prefer concise summaries with high-level metrics and ROI figures; lengthy reports reduce engagement and obscure key findings.
Question 6: A Certified Experiential Specialist receives participant feedback ratings of 4.8/5 on a post-event survey. What limitation does this data have?
- It is too detailed for practical use
- Reaction-level satisfaction scores do not confirm that learning occurred or that behavior will change (Correct answer)
- The scale should be 1–10 rather than 1–5 to be valid
- Participant feedback is not an accepted evaluation method
Correct answer: Reaction-level satisfaction scores do not confirm that learning occurred or that behavior will change
High satisfaction ratings (Level 1) indicate participants enjoyed the experience but do not measure whether learning was retained or behavior was transferred back to the workplace.
Question 7: When calculating the total cost of an experiential program for an ROI analysis, which cost category is most often overlooked?
- Venue rental fees
- Facilitator honorarium
- Participant time away from their job (opportunity cost) (Correct answer)
- Printed materials and supplies
Correct answer: Participant time away from their job (opportunity cost)
Participant opportunity cost—the value of productive work time lost while attending the program—is frequently excluded from cost calculations, leading to understated program costs.
CET Measurement, Evaluation & ROI of Experiential Programs 2
In the Phillips ROI Methodology, which step is added beyond Kirkpatrick's four levels?