Psychometric Principles and Analysis Flashcards
7 cards from real CBT practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Psychometric Principles and Analysis flashcards as text
A passing score on a licensure exam is set by having subject matter experts rate the minimum competency required to answer each item correctly. This method is called:
Answer: The Angoff method
The Angoff method asks judges to estimate the probability that a minimally competent examinee would answer each item correctly, and averages these ratings to set the cut score.
In generalizability theory, the 'universe score' is conceptually analogous to which classical test theory concept?
Answer: True score
The universe score in G-theory represents the expected score over all conditions of measurement, paralleling the true score in classical test theory.
Which type of score interpretation compares an examinee's performance to a defined content domain rather than to other examinees?
Answer: Criterion-referenced interpretation
Criterion-referenced interpretation evaluates mastery of a defined domain, reporting what an examinee can or cannot do rather than comparing them to a normative group.
An examinee's score on a cognitive test is 115. The test has a reliability of 0.84 and a mean of 100. What concept explains why the examinee's true score estimate should be pulled toward the mean?
Answer: Regression to the mean
Regression to the mean occurs because observed scores contain measurement error; true score estimates are weighted averages of the observed score and the group mean, pulled toward the mean by unreliability.
What does a negative point-biserial correlation for a test item most likely indicate?
Answer: Higher-scoring examinees tend to answer the item incorrectly
A negative point-biserial means low total scorers pass the item more than high scorers, suggesting the item is flawed, miskeyed, or measures something different from the rest of the test.
In the context of differential item functioning (DIF), which condition is labeled 'uniform DIF'?
Answer: One group consistently outperforms another across all ability levels
Uniform DIF occurs when one group has a consistently higher probability of correct response across all ability levels, with no interaction between group membership and ability.
Which of the following indices is specifically designed to evaluate model-data fit for individual items under Item Response Theory?
Answer: Outfit mean square statistic
The outfit mean square statistic (and its counterpart infit) measures discrepancy between observed and model-expected responses for individual items, flagging item misfit in IRT.