IES Evaluation & Impact Measurement of Inclusive Events 4 — Questions and Answers
Question 1: Which data privacy principle is most critical when collecting demographic information for inclusion evaluation purposes?
- Requiring all attendees to provide complete demographic data to participate
- Collecting only the minimum necessary demographic data with explicit informed consent (Correct answer)
- Storing demographic data indefinitely for longitudinal trend analysis
- Sharing raw demographic data with all event sponsors
Correct answer: Collecting only the minimum necessary demographic data with explicit informed consent
Data minimization and informed consent are foundational privacy principles that protect attendees while enabling meaningful inclusion evaluation.
Question 2: An event planner wants to evaluate whether programming changes increased engagement among introverted and neurodivergent attendees. Which metric is most appropriate?
- Total number of sessions offered
- Self-reported engagement ratings disaggregated by attendees who self-identify as introverted or neurodivergent (Correct answer)
- Average session attendance across all programs
- Number of extracurricular social events held
Correct answer: Self-reported engagement ratings disaggregated by attendees who self-identify as introverted or neurodivergent
Self-reported engagement data from the specific target population directly measures whether the programming changes achieved their intended inclusive outcomes.
Question 3: A three-year longitudinal study of an inclusive conference finds belonging scores improved significantly. What additional analysis is required before attributing this to the inclusion initiatives?
- Calculate the cost of all inclusion programs over three years
- Control for confounding variables such as changes in attendee demographics or broader social trends (Correct answer)
- Replicate the same survey instrument at a non-inclusive event
- Increase the event's marketing budget to attract a larger sample
Correct answer: Control for confounding variables such as changes in attendee demographics or broader social trends
Without controlling for confounders, improvements cannot be confidently attributed to the inclusion initiatives rather than external factors.
Question 4: What is the primary purpose of a Theory of Change in inclusive event evaluation?
- To document the event budget allocation for inclusion programming
- To articulate the causal pathway from inclusion activities to long-term equity outcomes (Correct answer)
- To list all DEI certifications held by the event planning team
- To track the number of diversity-focused sessions on the program
Correct answer: To articulate the causal pathway from inclusion activities to long-term equity outcomes
A Theory of Change maps how specific activities lead to outcomes and impacts, providing the logical framework for measuring whether an inclusive event strategy works.
Question 5: Which stakeholder group should receive the inclusion evaluation report, beyond internal event leadership?
- Only the event's legal team for liability purposes
- The communities whose inclusion was measured, sponsors, and partner organizations (Correct answer)
- Exclusively the event's board of directors
- Only the venue management team
Correct answer: The communities whose inclusion was measured, sponsors, and partner organizations
Transparency with affected communities, sponsors, and partners builds accountability and trust while enabling collaborative improvement.
Question 6: An IES is comparing pre- and post-event surveys to measure the impact of a mental health programming track. Which threat to validity must be addressed?
- The length of the survey instrument
- Respondent self-selection bias, since only those who attended mental health sessions may complete related survey questions (Correct answer)
- The cost of administering both surveys
- Whether the mental health sessions had celebrity speakers
Correct answer: Respondent self-selection bias, since only those who attended mental health sessions may complete related survey questions
Self-selection bias occurs when only attendees with pre-existing interest in mental health complete those questions, skewing results and limiting generalizability.
Question 7: Which evaluation design provides the strongest evidence that an accessibility innovation caused improved participation rates among attendees with mobility impairments?
- A single post-event survey administered after implementing the innovation
- A quasi-experimental design comparing participation rates at similar events with and without the innovation (Correct answer)
- Anecdotal testimonials collected from a few satisfied attendees
- A review of the innovation's purchase receipts and installation records
Correct answer: A quasi-experimental design comparing participation rates at similar events with and without the innovation
Quasi-experimental designs with comparison groups provide stronger causal evidence than single-group pre-post designs or anecdotal data.
IES Evaluation & Impact Measurement of Inclusive Events 4
Which data privacy principle is most critical when collecting demographic information for inclusion evaluation purposes?