CHSE Research Principles and Quality Improvement in Simulation — Questions and Answers
Question 1: A simulation educator wants to study whether a new debriefing method improves learner performance. The FIRST step before collecting any data should be to:
- Pilot the new debriefing method with a small group of volunteers
- Submit the study to an institutional review board (IRB) for ethical review (Correct answer)
- Obtain written informed consent from all future participants
- Publish a protocol describing the research design in a simulation journal
Correct answer: Submit the study to an institutional review board (IRB) for ethical review
Ethical review by an IRB (or equivalent body) must occur before any human subjects research begins — including before consent procedures are initiated. This requirement protects participants and is a regulatory prerequisite for conducting research.
Question 2: Which of the following BEST distinguishes quality improvement (QI) from formal research in a simulation program?
- QI uses quantitative methods while research exclusively uses qualitative methods
- QI aims to improve local practice and typically does not require IRB approval, while research generates generalizable knowledge requiring ethical oversight (Correct answer)
- QI is conducted by educators while research is conducted only by administrators
- QI applies only to clinical settings, not simulation-based education programs
Correct answer: QI aims to improve local practice and typically does not require IRB approval, while research generates generalizable knowledge requiring ethical oversight
QI is aimed at improving processes within a specific institution and generally does not require IRB approval. Research generates generalizable knowledge intended for broader dissemination and must undergo ethical review. This distinction has significant practical implications for simulation program leaders.
Question 3: A simulation program wants to use a Plan-Do-Study-Act (PDSA) cycle. What is the PRIMARY purpose of this QI methodology?
- To design simulation scenarios from scratch using an established instructional framework
- To obtain institutional funding approval for new simulation equipment purchases
- To test small-scale changes, evaluate their impact, and refine before broader implementation (Correct answer)
- To assess individual learner competency at the conclusion of a training program
Correct answer: To test small-scale changes, evaluate their impact, and refine before broader implementation
PDSA cycles are iterative QI tools designed to test changes on a small scale, study the effect, and act on findings before committing to full implementation. This rapid-cycle approach allows programs to improve safely and efficiently.
Question 4: A simulation educator is reviewing literature to identify evidence-based practices for their debrief training program. Which source provides the HIGHEST quality evidence?
- A single case report from a peer-reviewed simulation journal
- Expert opinion published as a commentary by a senior simulation educator
- A systematic review or meta-analysis of multiple simulation debriefing studies (Correct answer)
- The simulation program's own historical outcome data from the past two years
Correct answer: A systematic review or meta-analysis of multiple simulation debriefing studies
Systematic reviews and meta-analyses sit at the top of the evidence hierarchy because they synthesize findings across multiple studies, reducing the risk of bias present in any single study. They provide the strongest foundation for evidence-based practice decisions.
Question 5: A simulation educator reports that their study found improved team communication scores after a new training module. However, the sample consisted entirely of learners from a single rural community hospital. This PRIMARILY limits the study's:
- Internal validity
- Reliability
- Statistical significance
- External validity (generalizability) (Correct answer)
Correct answer: External validity (generalizability)
External validity refers to the degree to which study findings can be generalized to other settings, populations, or contexts. A single-institution sample from one type of facility limits confidence that the findings would hold across diverse healthcare environments.
Question 6: A simulation program director wants to demonstrate the value of their program to hospital administration. Which metric BEST aligns with a quality improvement approach to patient safety outcomes?
- Learner satisfaction ratings collected immediately after simulation sessions
- Number of simulation sessions conducted per quarter across all departments
- Reduction in catheter-associated urinary tract infection (CAUTI) rates following a targeted simulation training initiative (Correct answer)
- Instructor ratings of scenario realism and manikin fidelity during debriefs
Correct answer: Reduction in catheter-associated urinary tract infection (CAUTI) rates following a targeted simulation training initiative
Meaningful QI metrics should directly measure the intended patient safety impact of the program. A documented reduction in CAUTI rates attributable to the training initiative demonstrates real-world clinical improvement, which is the ultimate goal of patient safety simulation.
CHSE Research Principles and Quality Improvement in Simulation
A simulation educator wants to study whether a new debriefing method improves learner performance.
The FIRST step before collecting any data should be to: