CDT Assessment & Evaluation of Diversity Programs 3 — Questions and Answers
Question 1: Which type of validity ensures that a diversity assessment instrument measures all major aspects of the construct it intends to measure?
- Predictive validity
- Content validity (Correct answer)
- Concurrent validity
- Discriminant validity
Correct answer: Content validity
Content validity confirms that the assessment items adequately cover the full domain of the construct (e.g., inclusive leadership), not just a narrow slice of it.
Question 2: An evaluator uses anonymous pulse surveys sent monthly to track cultural climate shifts during a year-long DEI initiative. This approach is an example of:
- Summative evaluation
- Formative evaluation (Correct answer)
- Meta-evaluation
- Return on investment analysis
Correct answer: Formative evaluation
Formative evaluation occurs during program implementation and provides ongoing feedback used to make real-time improvements, as opposed to summative evaluation done after completion.
Question 3: When an organization's diversity report shows demographic representation improved but exit interview data reveals marginalized employees still feel excluded, this gap reflects which evaluation challenge?
- Insufficient budget allocation
- The difference between representation metrics and inclusion outcomes (Correct answer)
- Lack of managerial buy-in for diversity training
- Poor training facilitator performance
Correct answer: The difference between representation metrics and inclusion outcomes
Diversity metrics measure who is present, while inclusion outcomes measure whether those individuals feel valued and belonging—these two dimensions often diverge.
Question 4: A DEI trainer wants to ensure their newly designed assessment is consistent across different raters who score open-ended responses. They should establish:
- Face validity
- Inter-rater reliability (Correct answer)
- Test-retest reliability
- Predictive validity
Correct answer: Inter-rater reliability
Inter-rater reliability measures the degree to which different evaluators assign consistent scores to the same response, ensuring the scoring process itself is objective.
Question 5: Which stakeholder group is MOST critical to involve during the evaluation design phase of a diversity program to ensure cultural relevance of assessment tools?
- External consultants only
- Senior leadership exclusively
- Members of the communities being assessed (Correct answer)
- Finance department staff
Correct answer: Members of the communities being assessed
Involving community members in evaluation design ensures instruments are culturally appropriate, reduces measurement bias, and increases buy-in from those being assessed.
Question 6: A trainer reports that 95% of attendees rated the diversity workshop 'excellent.' What critical information does this statistic fail to provide?
- The number of attendees
- Whether the training produced any change in knowledge, attitudes, or behavior (Correct answer)
- The cost per participant
- The demographic breakdown of facilitators
Correct answer: Whether the training produced any change in knowledge, attitudes, or behavior
Satisfaction ratings (Kirkpatrick Level 1) only capture how participants felt about the training, not whether it led to learning or behavior change.
Question 7: Scenario: A company implemented unconscious bias training for all 500 employees. One year later, discrimination complaints increased. What evaluation step should the trainer take FIRST?
- Immediately discontinue the training program
- Conduct a root-cause analysis to understand what is driving the complaint increase (Correct answer)
- Expand the training to include vendors and contractors
- Raise training frequency from annual to quarterly
Correct answer: Conduct a root-cause analysis to understand what is driving the complaint increase
Before changing or eliminating a program, a root-cause analysis determines whether the increase reflects rising awareness and reporting rather than worsening behavior.
CDT Assessment & Evaluation of Diversity Programs 3
Which type of validity ensures that a diversity assessment instrument measures all major aspects of the construct it intends to measure?