Debriefing and Assessment Methods Flashcards

An educator is using a global rating scale (GRS) instead of a detailed checklist to assess teamwork skills during a complex trauma scenario. What is the primary advantage of using a GRS for this type of assessment?

Answer: It better captures nuanced aspects of performance and the integration of skills that are difficult to itemize.

A global rating scale (GRS) is designed to assess broader domains of performance, such as communication, teamwork, or clinical decision-making. Unlike a checklist, which focuses on the completion of specific, individual tasks, a GRS allows an evaluator to make a more holistic judgment about the quality and integration of complex skills. This makes it particularly well-suited for assessing nuanced behaviors that are difficult to break down into a binary (done/not done) format.

During a debriefing, a facilitator observes that a learner is visibly upset and quiet after a difficult scenario. The facilitator says, "I noticed you became quiet during the last part of the scenario. I was thinking it might have been a challenging moment. Can you help me understand what was going on for you at that time?" This is a classic example of which debriefing technique?

Answer: Advocacy-Inquiry

The Advocacy-Inquiry technique involves the facilitator making an observation (advocacy) and then asking a genuine question (inquiry) to explore the learner's underlying thought processes or 'frames'. The statement pairs an observation ("I noticed you became quiet...") with an inquiry ("Can you help me understand...?") to open a safe and curious dialogue, which is the hallmark of this method.

Which of the following scenarios best describes a summative assessment in a simulation-based curriculum?

Answer: A medical resident performing a simulated central line insertion that must be passed before being allowed to perform the procedure on patients.

Summative assessment is an 'assessment OF learning' used to evaluate a learner's competence at the end of an instructional period, often with a pass/fail consequence. Requiring a resident to pass a simulated procedure before performing it clinically is a high-stakes evaluation of mastery, which is characteristic of a summative assessment. The other options describe formative assessments, which are 'assessments FOR learning' and focus on providing feedback for improvement.

A simulation program is using the Plus-Delta model for debriefing. A novice facilitator notices that during the 'Delta' (Δ) phase, learners are only listing things that went wrong without discussing how to improve. What is the most appropriate action for the facilitator to take?

Answer: Refocus the conversation by asking, "Based on what we've identified, what specific actions could we take to change the outcome next time?"

The 'Delta' (Δ) in the Plus-Delta model is meant to identify what could be changed or done differently for improvement, not just list errors. The facilitator's role is to guide the learners from simple critique to constructive planning. Refocusing the question towards actionable changes directly addresses the purpose of the 'Delta' phase and promotes reflective learning.

A key principle of the "Debriefing with Good Judgment" approach is to uncover the learner's 'frames.' What does the term 'frames' refer to in this context?

Answer: The learner's underlying assumptions, knowledge, and feelings that drive their actions.

In the "Debriefing with Good Judgment" model, 'frames' are the internal cognitive and emotional structures—such as assumptions, feelings, knowledge, and goals—that shape how a learner perceives a situation and, consequently, how they act. The goal of debriefing is to make these invisible frames visible to help the learner reflect on why they took certain actions.

Which of the following assessment methods is designed primarily for learning and skill acquisition DURING the simulation activity itself, rather than after?

Answer: Rapid Cycle Deliberate Practice (RCDP)

Rapid Cycle Deliberate Practice (RCDP) is a formative assessment and learning method where the simulation is repeatedly paused to provide immediate, directive feedback and allow the learner to practice and correct their performance in real-time. This 'pause-and-coach' cycle is unique in its focus on skill acquisition during the scenario, as opposed to post-event reflection or evaluation.