Exam Components Flashcards

The PEBC Qualifying Examination Part I uses a modified Angoff method for standard setting. What does this process primarily determine?

Answer: The cut score by estimating how a borderline competent candidate would perform on each item

The modified Angoff method involves subject matter experts estimating the probability that a minimally competent (borderline) candidate would answer each item correctly. These estimates are averaged across items to produce a recommended cut score. This is distinct from norm-referencing, which compares candidates to each other rather than to an absolute standard.

A candidate completes the PEBC Qualifying Examination Part II OSCE and receives a 'borderline fail' on two stations. Which statement most accurately reflects how this result is processed?

Answer: Global station scores are summed and the candidate passes or fails based on total score relative to the overall cut score, not individual station thresholds

PEBC QE Part II uses a compensatory scoring model for the OSCE. The candidate's overall performance across all stations is aggregated, and the final pass/fail decision is based on the total score compared to the overall cut score — not on passing each individual station. A borderline fail on two stations can be compensated by strong performance on others.

Which of the following correctly describes a key structural difference between the PEBC Evaluating Examination (EE) and the Qualifying Examination Part I (QE Part I)?

Answer: The EE is designed to assess equivalency to a Canadian pharmacy graduate, while QE Part I assesses entry-to-practice competency for all candidates

The Evaluating Examination is specifically designed for internationally educated pharmacists (IEPs) to determine whether their education and training is substantially equivalent to a Canadian pharmacy graduate. QE Part I, by contrast, is an entry-to-practice exam sat by all candidates (including Canadian graduates) to assess readiness for independent practice. The EE does not itself grant a licence — it is a prerequisite gateway for IEPs to proceed.

In the context of PEBC Qualifying Examination Part II station design, what is the primary purpose of the 'examiner anchor statements' provided in the rating guide?

Answer: To define behavioural benchmarks at each point on the rating scale to reduce inter-rater variability

Anchor statements are specific behavioural descriptors attached to each rating scale level (e.g., 'Fail,' 'Borderline,' 'Pass,' 'Superior'). They calibrate examiner judgment by describing what observable candidate behaviours correspond to each score point, thereby reducing subjectivity and improving inter-rater reliability across different examiners and sites.

A candidate sitting the PEBC QE Part I encounters an item that presents a patient case followed by three questions, each referring back to the same case. What is the specific term for this item format, and what is its primary psychometric risk?

Answer: Testlet format; primary risk is item independence violation, where a correct answer to a later item depends on a correct answer to an earlier item

This is called a testlet (or item set). The major psychometric concern is local item dependence: if a candidate answers an early item incorrectly, it may systematically affect their ability to answer subsequent items within the same testlet, violating the assumption of statistical independence between items. This can distort reliability estimates and scoring if not properly handled in the test design.

PEBC examination blueprints specify the proportion of items drawn from each competency framework category. If a future blueprint revision increases the weighting of the 'Collaboration' competency from 5% to 12% of the QE Part I, which validity argument is MOST directly strengthened by this change?

Answer: Content validity, because the test blueprint more accurately reflects the relative importance of collaboration in contemporary pharmacy practice

Content validity (or content-related evidence of validity) refers to whether the exam adequately and proportionally samples the domain it purports to measure. Adjusting blueprint weights to reflect current practice standards — such as increasing collaboration weighting to align with evolving pharmacist roles — directly addresses whether the test's content coverage mirrors the real-world construct. Criterion and construct validity involve different evidence sources (predictive outcomes and internal structure, respectively).