CHSE Debriefing and Evaluation 3 — Questions and Answers
Question 1: Which principle of adult learning theory (andragogy) is MOST directly applied when debriefing begins by asking learners how they felt during the scenario?
- Adults prefer didactic instruction over experiential learning
- Adults bring prior experience that serves as a resource for learning (Correct answer)
- Adults learn best in competitive environments
- Adults require external motivation to engage in reflection
Correct answer: Adults bring prior experience that serves as a resource for learning
Knowles' andragogy emphasizes that adult learners draw on prior experience; opening debriefing with emotional check-in honors that experience as a learning resource.
Question 2: The Kirkpatrick Model Level 3 evaluation in simulation education assesses:
- Learner satisfaction with the simulation experience
- Knowledge and skill gains immediately after training
- Transfer of learned behaviors to actual clinical practice (Correct answer)
- Organizational outcomes such as reduced adverse events
Correct answer: Transfer of learned behaviors to actual clinical practice
Kirkpatrick Level 3 (Behavior) measures whether training has transferred to on-the-job performance in the real clinical environment.
Question 3: A simulator educator uses video playback during debriefing primarily to:
- Entertain learners after a stressful scenario
- Provide objective evidence that grounds reflective discussion (Correct answer)
- Replace the need for a verbal debrief
- Satisfy accreditation recording requirements
Correct answer: Provide objective evidence that grounds reflective discussion
Video replay offers concrete, shared reference points that reduce memory distortion and focus debriefing on observed rather than interpreted behaviors.
Question 4: Which statement BEST describes 'debriefing with good judgment' as described by Rudolph et al.?
- Avoiding all negative feedback to protect psychological safety
- Stating observations and exploring the learner's reasoning without blaming (Correct answer)
- Focusing exclusively on what went well to build confidence
- Using a scripted set of questions regardless of learner responses
Correct answer: Stating observations and exploring the learner's reasoning without blaming
Debriefing with good judgment involves sharing honest observations while genuinely exploring the learner's mental model to understand their actions.
Question 5: In simulation program evaluation, content validity of a checklist refers to:
- The degree to which the checklist correlates with a gold-standard measure
- The extent to which checklist items adequately represent the domain being assessed (Correct answer)
- The consistency of scores across multiple raters
- The stability of scores over repeated administrations
Correct answer: The extent to which checklist items adequately represent the domain being assessed
Content validity ensures checklist items comprehensively sample the relevant knowledge or skill domain, typically established through expert review.
Question 6: Which action by a debriefer most undermines psychological safety?
- Asking open-ended questions about clinical reasoning
- Publicly assigning blame to a specific learner for a poor outcome (Correct answer)
- Summarizing key learning points at the end of debriefing
- Pausing before responding to allow reflection time
Correct answer: Publicly assigning blame to a specific learner for a poor outcome
Public blame triggers shame and defensiveness, shutting down the reflective capacity needed for learning and violating the safe container of debriefing.
Question 7: An inter-rater reliability coefficient of 0.90 between two simulation evaluators indicates:
- Both raters scored identical learners very differently
- The assessment tool has poor construct validity
- High consistency between the two raters' independent judgments (Correct answer)
- The scenario was too easy to reveal performance differences
Correct answer: High consistency between the two raters' independent judgments
A coefficient near 1.0 reflects strong agreement between raters, meaning the tool produces consistent scores regardless of who is doing the evaluation.
CHSE Debriefing and Evaluation 3
Which principle of adult learning theory (andragogy) is MOST directly applied when debriefing begins by asking learners how they felt during the scenario?