Change Management Research & Evidence-Based Practice 5 — Questions and Answers
Question 1: Which of the following represents the highest level of evidence in most evidence hierarchies applied to change management?
- Expert opinion
- Single case study
- Systematic review with meta-analysis (Correct answer)
- Cross-sectional survey
Correct answer: Systematic review with meta-analysis
Systematic reviews with meta-analysis synthesize findings across multiple rigorous studies, providing the strongest cumulative evidence.
Question 2: An organization pilots a change intervention with one team and measures outcomes. Before scaling, the change manager should:
- Immediately roll out the intervention organization-wide based on pilot success
- Evaluate whether the pilot context is representative of the broader organization (Correct answer)
- Discard the pilot data and commission a full academic study
- Wait for industry benchmarks before proceeding
Correct answer: Evaluate whether the pilot context is representative of the broader organization
Contextual differences between the pilot group and the broader organization may limit the applicability of pilot results.
Question 3: A change team uses 'after-action reviews' systematically to build an evidence base. This practice primarily supports:
- Compliance with external audit requirements
- Organizational learning by capturing and analyzing experiential data (Correct answer)
- Reducing employee resistance to future changes
- Improving financial forecasting accuracy
Correct answer: Organizational learning by capturing and analyzing experiential data
After-action reviews generate practitioner evidence by systematically reflecting on what worked and what didn't in past change efforts.
Question 4: When PROSCI's benchmarking research is cited in a change plan, practitioners should be aware that:
- PROSCI research uses randomized designs, ensuring high causal validity
- PROSCI surveys are practitioner-reported and may be subject to self-selection and response bias (Correct answer)
- PROSCI findings are universally applicable across all industries
- PROSCI data is peer-reviewed and methodologically equivalent to academic research
Correct answer: PROSCI surveys are practitioner-reported and may be subject to self-selection and response bias
PROSCI's research is based on self-reported practitioner surveys, which can introduce selection and social desirability biases.
Question 5: A change manager wants to understand why employees resisted a digital transformation. Which method would yield the richest contextual understanding?
- Quantitative analysis of absenteeism rates
- In-depth semi-structured interviews with resistant employees (Correct answer)
- Benchmarking resistance rates against industry norms
- Statistical analysis of help-desk ticket volumes
Correct answer: In-depth semi-structured interviews with resistant employees
Semi-structured interviews allow employees to articulate nuanced reasons for resistance that quantitative methods cannot fully capture.
Question 6: Which concept describes the risk that change management research conducted in one national culture may not apply in another?
- Sampling error
- Cross-cultural generalizability threat (Correct answer)
- Construct invalidity
- Temporal confounding
Correct answer: Cross-cultural generalizability threat
Cultural differences in values, norms, and organizational behavior can significantly affect whether change management findings transfer across national contexts.
Question 7: An evidence-based change manager encounters two high-quality studies with conflicting findings on communication frequency during change. The most appropriate response is to:
- Discard both studies and rely on personal experience
- Investigate the contextual differences between studies that may explain the conflicting results (Correct answer)
- Apply whichever finding aligns with the current change plan
- Conduct an entirely new study before making any decisions
Correct answer: Investigate the contextual differences between studies that may explain the conflicting results
Conflicting evidence often reflects contextual moderators; understanding study differences helps practitioners determine which findings apply to their situation.
Change Management Research & Evidence-Based Practice 5
Which of the following represents the highest level of evidence in most evidence hierarchies applied to change management?