FREE CHSE Assessment and Evaluation Methods Questions and Answers

Question 1

A simulation educator runs a 'mock code' scenario for residents halfway through their rotation.
The educator provides immediate, targeted feedback on performance using a checklist but does not assign a grade.
The primary goal is to identify areas for improvement before the end of the rotation.
This is an example of which type of assessment?

Accepted Answer

Formative assessment

Answer

Summative assessment

Answer

Ipsative assessment

Answer

Diagnostic assessment

Question 2

An educator is designing an assessment for a complex skill, such as breaking bad news, which involves empathy, rapport-building, and adapting to emotional cues. Which assessment tool is most appropriate for capturing the nuances of a learner's performance in these domains?

Accepted Answer

A global rating scale with descriptive anchors

Answer

A binary (done/not done) procedural checklist

Answer

A post-simulation multiple-choice question test

Answer

A structured peer-evaluation survey

Question 3

A simulation program is implementing a high-stakes Objective Structured Clinical Examination (OSCE) to credential learners for a specific procedure. To ensure fairness and consistency in scoring across all participants, which of the following is the most critical element to implement?

Accepted Answer

Conducting robust rater training to establish inter-rater reliability

Answer

Using the newest high-fidelity manikin available

Answer

Providing learners with the scoring tool beforehand

Answer

Ensuring the moulage is identical for every learner

Question 4

A simulation program director is using the CIPP (Context, Input, Process, Product) model to conduct a comprehensive evaluation of a new curriculum. Which of the following questions would be addressed during the 'Input' evaluation phase?

Accepted Answer

Are the available faculty, funding, and equipment adequate to implement the curriculum as planned?

Answer

Did the program achieve its intended learning outcomes for the participants?

Answer

Were the simulation scenarios and debriefings delivered consistently and according to the design?

Answer

What are the key institutional needs and priorities that this curriculum is designed to address?

Question 5

A CHSE convenes a panel of subject matter experts to establish a defensible pass/fail score for a new summative assessment. The experts review each item on the scoring tool and estimate the probability that a minimally competent practitioner would perform the item correctly. This process is a hallmark of which standard-setting method?

Accepted Answer

The Angoff method

Answer

The Kirkpatrick method

Answer

The Plus-Delta method

Answer

The BARS method

Question 6

An educator develops a new assessment checklist for a central venous catheter insertion scenario. To help establish the tool's validity, the educator asks a group of experienced intensivists to review the checklist to ensure it includes all critical steps and excludes any irrelevant ones. This activity is primarily focused on gathering what type of validity evidence?

Accepted Answer

Content validity

Answer

Predictive validity

Answer

Concurrent validity

Answer

Construct validity