IES Evaluation & Impact Measurement of Inclusive Events 2 — Questions and Answers
Question 1: A post-event survey reveals that attendees with disabilities rated accessibility 3.2/5 while non-disabled attendees rated it 4.6/5. What should an IES prioritize in the gap analysis?
- Disregard the gap since the overall average is acceptable
- Investigate specific barriers experienced by attendees with disabilities (Correct answer)
- Increase the sample size before drawing conclusions
- Report only the overall average to avoid negative optics
Correct answer: Investigate specific barriers experienced by attendees with disabilities
Disaggregating satisfaction data by demographic group reveals equity gaps that overall averages obscure, enabling targeted improvements.
Question 2: Which method best captures real-time accessibility barriers during a large hybrid event?
- Annual post-event written surveys
- Live feedback kiosks and on-site accessibility liaisons (Correct answer)
- Reviewing previous year's event reports only
- Interviewing only the event planning team after the event
Correct answer: Live feedback kiosks and on-site accessibility liaisons
Real-time feedback mechanisms like kiosks and accessibility liaisons allow immediate identification and resolution of barriers during the event.
Question 3: An inclusive event strategist wants to measure whether language access services reduced participation barriers. Which metric is most direct?
- Total event revenue
- Registration rates among non-English-speaking attendees before and after adding interpretation services (Correct answer)
- Number of interpreters hired
- Social media mentions mentioning the event
Correct answer: Registration rates among non-English-speaking attendees before and after adding interpretation services
Comparing registration rates among the target demographic before and after the intervention directly measures the service's impact on participation barriers.
Question 4: When designing an inclusion-focused evaluation framework, disaggregating data by disability status, race, and gender is essential primarily because:
- It satisfies legal reporting requirements automatically
- It ensures marginalized groups' experiences are not averaged away (Correct answer)
- It increases the total sample size of respondents
- It simplifies the data analysis process
Correct answer: It ensures marginalized groups' experiences are not averaged away
Disaggregation prevents the erasure of distinct group experiences within aggregate data, revealing equity disparities.
Question 5: Which evaluation approach aligns most closely with the principle of 'nothing about us without us' in inclusive event measurement?
- Having the event planning team review feedback and summarize it for leadership
- Engaging community members from underrepresented groups in co-designing the evaluation instruments (Correct answer)
- Commissioning an external consultant to conduct all evaluations
- Using only standardized industry benchmarks without customization
Correct answer: Engaging community members from underrepresented groups in co-designing the evaluation instruments
Co-designing evaluation tools with affected communities ensures metrics capture what matters most to those communities and reflects their lived experience.
Question 6: A strategist tracks 'sense of belonging' as an outcome metric for an inclusive conference. Which data collection tool is most appropriate for this qualitative construct?
- Revenue per attendee calculations
- Validated Likert-scale belonging surveys with open-ended follow-up questions (Correct answer)
- Counting the number of diverse speakers in the program
- Attendance headcount reports
Correct answer: Validated Likert-scale belonging surveys with open-ended follow-up questions
Validated psychometric scales paired with qualitative open-ended questions are the standard approach for measuring subjective constructs like belonging.
Question 7: An IES receives quantitative data showing 90% satisfaction but qualitative feedback describing microaggressions throughout the event. How should this discrepancy be addressed?
- Report only the quantitative data since it is statistically significant
- Investigate the qualitative feedback to understand the gap and update future survey instruments (Correct answer)
- Dismiss the qualitative comments as outliers
- Raise the satisfaction target to 95% next year
Correct answer: Investigate the qualitative feedback to understand the gap and update future survey instruments
Qualitative feedback often captures nuanced equity issues that high satisfaction scores can mask, requiring investigation and instrument improvement.
IES Evaluation & Impact Measurement of Inclusive Events 2
A post-event survey reveals that attendees with disabilities rated accessibility 3.2/5 while non-disabled attendees rated it 4.6/5.
What should an IES prioritize in the gap analysis?