CHSE Debriefing and Assessment Methods 3 — Questions and Answers
Question 1: Which level of Kirkpatrick's evaluation model measures whether learners actually changed their on-the-job behavior after simulation training?
- Level 1 – Reaction
- Level 2 – Learning
- Level 3 – Behavior (Correct answer)
- Level 4 – Results
Correct answer: Level 3 – Behavior
Kirkpatrick Level 3 evaluates transfer of learned skills to the actual workplace, assessing behavioral change over time.
Question 2: A debriefer who primarily tells learners what they did wrong without inviting their perspective is using which debriefing style?
- Facilitator-guided
- Learner-centered
- Directive (Correct answer)
- Co-debriefing
Correct answer: Directive
A directive debriefing style involves the educator providing evaluative feedback without soliciting learner self-reflection.
Question 3: What is the PRIMARY purpose of the 'reactions' phase at the start of a debriefing session?
- Correct all clinical errors immediately
- Allow learners to vent emotions before analytical discussion (Correct answer)
- Review learning objectives with the group
- Assign scores on performance checklists
Correct answer: Allow learners to vent emotions before analytical discussion
The reactions phase helps learners process emotions from the simulation before engaging in cognitive analysis of performance.
Question 4: Standardized patients (SPs) contribute to assessment validity MOST when they are trained to:
- Improvise responses based on learner performance
- Provide consistent, scripted portrayals and reliable checklists (Correct answer)
- Act as peer evaluators without structured criteria
- Focus solely on learner communication skills
Correct answer: Provide consistent, scripted portrayals and reliable checklists
Consistency in SP portrayal and use of structured checklists ensures that assessments measure actual learner performance rather than SP variability.
Question 5: In simulation assessment, 'inter-rater reliability' refers to:
- The degree to which a test measures what it intends to measure
- Agreement between two or more raters scoring the same performance (Correct answer)
- The consistency of scores across multiple test administrations
- The extent to which assessment results predict future performance
Correct answer: Agreement between two or more raters scoring the same performance
Inter-rater reliability measures how consistently different evaluators score the same learner performance on the same criteria.
Question 6: During a team simulation debrief, one team member dominates the conversation. The BEST debriefing strategy is to:
- Allow the dominant speaker to continue since their insight is valuable
- Redirect the discussion using inclusive language to invite other voices (Correct answer)
- Pause the debrief and privately reprimand the dominant learner
- End the group debrief and switch to individual meetings
Correct answer: Redirect the discussion using inclusive language to invite other voices
Inclusive facilitation techniques such as 'let's hear from someone who hasn't spoken yet' redistribute participation and maximize learning.
Question 7: Which assessment approach requires learners to demonstrate clinical skills in a simulated environment rather than just recalling knowledge?
- Multiple-choice examination
- Written case vignette
- Performance-based assessment (Correct answer)
- Peer-reviewed portfolio
Correct answer: Performance-based assessment
Performance-based assessment evaluates competency by observing what learners can actually do in a controlled simulation context.
CHSE Debriefing and Assessment Methods 3
Which level of Kirkpatrick's evaluation model measures whether learners actually changed their on-the-job behavior after simulation training?