FREE CHSE Assessment and Evaluation Methods Questions and Answers

Question 1

A simulation educator runs a 'mock code' scenario for residents halfway through their rotation. The educator provides immediate, targeted feedback on performance using a checklist but does not assign a grade. The primary goal is to identify areas for improvement before the end of the rotation. This is an example of which type of assessment?

Accepted Answer

Formative assessment

Answer

Formative assessment is conducted during the learning process to monitor progress and provide ongoing feedback to improve learning. [13, 21, 28] Since the goal is to identify areas for improvement without assigning a final grade, it is formative. Summative assessment evaluates learning at the end of an instructional unit. [21, 27]

Question 2

An educator is designing an assessment for a complex skill, such as breaking bad news, which involves empathy, rapport-building, and adapting to emotional cues. Which assessment tool is most appropriate for capturing the nuances of a learner's performance in these domains?

Accepted Answer

A global rating scale with descriptive anchors

Answer

A global rating scale (GRS) is better suited for assessing complex skills and behaviors like communication and professionalism. [8, 12, 17] Unlike a binary checklist that focuses on discrete actions, a GRS with descriptive anchors allows raters to make a holistic judgment about the quality of a performance across a continuum. [12]

Question 3

A simulation program is implementing a high-stakes Objective Structured Clinical Examination (OSCE) to credential learners for a specific procedure. To ensure fairness and consistency in scoring across all participants, which of the following is the most critical element to implement?

Accepted Answer

Conducting robust rater training to establish inter-rater reliability

Answer

For any performance-based assessment, especially a high-stakes one, ensuring that different raters score the same performance consistently is paramount for fairness and validity. [18, 19, 23] Robust rater training is the primary method to achieve high inter-rater reliability, minimizing variability that comes from examiner judgment. [19, 23]

Question 4

A simulation program director is using the CIPP (Context, Input, Process, Product) model to conduct a comprehensive evaluation of a new curriculum. Which of the following questions would be addressed during the 'Input' evaluation phase?

Accepted Answer

Are the available faculty, funding, and equipment adequate to implement the curriculum as planned?

Answer

The 'Input' phase of the CIPP model focuses on assessing the adequacy of resources, the feasibility of the plan, and the potential strategies. [2, 11, 16] It answers the question, 'How should it be done?' [11] 'Product' evaluation addresses outcomes (A), 'Process' evaluation addresses implementation fidelity (C), and 'Context' evaluation addresses needs (D). [2, 16]

Question 5

A CHSE convenes a panel of subject matter experts to establish a defensible pass/fail score for a new summative assessment. The experts review each item on the scoring tool and estimate the probability that a minimally competent practitioner would perform the item correctly. This process is a hallmark of which standard-setting method?

Accepted Answer

The Angoff method

Answer

The Angoff method is a widely used, evidence-based procedure where a panel of experts evaluates assessment items to determine a cut-score based on the expected performance of a 'minimally competent' individual. [1, 4, 6] This approach bases the passing standard on the content of the exam, not on the performance of the group taking it. [4, 5]

(CHSE) Certified Healthcare Simulation Educator Practice Test

(CHSE) Certified Healthcare Simulation Educator Practice Test

FREE CHSE Assessment and Evaluation Methods Questions and Answers