BCP Scoring Accuracy and Norms Questions and Answers 1 — Questions and Answers
Question 1: A psychometrist is scoring a vocabulary subtest where an examinee's response is ambiguous. The scoring manual provides several examples, but none perfectly match the examinee's answer. What is the most appropriate action for the psychometrist to take?
- Record the response verbatim and query the supervising psychologist for a scoring decision. (Correct answer)
- Use their best clinical judgment to award partial credit based on the perceived quality of the response.
- Score the item as a zero to maintain strict standardization.
- Search online forums for how other psychometrists have scored similar responses.
Correct answer: Record the response verbatim and query the supervising psychologist for a scoring decision.
The psychometrist's primary role is to administer tests and record data accurately according to standardized procedures. When scoring rules are ambiguous for a specific response, the correct protocol is to record the response verbatim and consult with the supervising licensed psychologist, who holds the ultimate responsibility for scoring and interpretation.
Question 2: The primary purpose of converting an examinee's raw score on a standardized test into a standard score (e.g., scaled score, T-score) is to:
- Simplify the process of data entry into electronic health records.
- Provide a score that can be easily understood by the examinee and their family.
- Allow for the comparison of the examinee's performance to that of a representative normative sample. (Correct answer)
- Calculate the exact number of items the examinee answered correctly.
Correct answer: Allow for the comparison of the examinee's performance to that of a representative normative sample.
Raw scores by themselves are difficult to interpret. Converting them to standard scores provides a frame of reference by indicating how an individual performed relative to a standardized, representative group of peers (the normative sample). This allows for meaningful interpretation and comparison of test performance across different measures.
Question 3: An examinee obtains a percentile rank of 84 on a test of cognitive ability. This score indicates that the examinee:
- Answered 84% of the test questions correctly.
- Performed as well as or better than 84% of their peers in the normative sample. (Correct answer)
- Scored within the 'Average' range of performance.
- Has a standard score that is 1.5 standard deviations above the mean.
Correct answer: Performed as well as or better than 84% of their peers in the normative sample.
A percentile rank indicates the percentage of individuals in the normative sample who scored at or below a particular raw score. Therefore, a percentile rank of 84 means the individual's score was equal to or higher than the scores of 84% of the comparison group. This corresponds to a standard score approximately one standard deviation above the mean, which is typically considered 'High Average'.
Question 4: A psychometrist is double-checking their scoring of a lengthy test battery. Which of the following represents the most critical area to verify to prevent common and significant scoring inaccuracies?
- Ensuring the examinee's name is spelled correctly on all forms.
- Confirming the correct chronological age calculation and use of the corresponding norm table. (Correct answer)
- Verifying that all verbatim responses were recorded with perfect punctuation.
- Checking that the testing start and end times were recorded accurately.
Correct answer: Confirming the correct chronological age calculation and use of the corresponding norm table.
One of the most frequent and significant sources of scoring error is the incorrect calculation of chronological age or the subsequent selection of the wrong norm table. This single error can invalidate all standard scores derived from the raw data, leading to a completely flawed interpretation of the examinee's performance.
Question 5: When administering a subtest with a basal rule of '3 consecutive perfect scores,' the psychometrist begins at the age-appropriate start point. The examinee's scores on the initial items are: Item 5=1, Item 6=2, Item 7=1. According to standardized procedure, what must the psychometrist do next?
- Continue forward with testing from Item 8, as the start point was followed.
- Stop the subtest because the examinee clearly finds it too difficult.
- Administer the preceding items (Item 4, 3, 2, etc.) in reverse order until a basal is established. (Correct answer)
- Give the examinee credit for all items up to Item 5 and continue forward.
Correct answer: Administer the preceding items (Item 4, 3, 2, etc.) in reverse order until a basal is established.
When a test is started at a specific item and the initial items do not meet the basal criteria, the psychometrist must administer the preceding items in reverse order until the basal rule is met. Full credit is then assumed for all items below the established basal. Failing to properly establish a basal is a significant procedural and scoring error.
Question 6: The normative sample for a new achievement test is described as being 'stratified on the basis of age, sex, race/ethnicity, and geographic region.' What is the primary purpose of this sampling method?
- To ensure the test is completely free of cultural bias.
- To make the test easier to score by creating subgroups.
- To reduce the overall number of participants needed for standardization.
- To ensure the sample is representative of the larger population for whom the test is intended. (Correct answer)
Correct answer: To ensure the sample is representative of the larger population for whom the test is intended.
Stratification is a sampling technique used to ensure that specific subgroups within a population are represented in the normative sample in the same proportion as they exist in the actual population (e.g., based on census data). This is critical for creating norms that allow for fair and accurate comparisons of an individual's score to their peer group.
BCP Scoring Accuracy and Norms Questions and Answers 1
A psychometrist is scoring a vocabulary subtest where an examinee's response is ambiguous.
The scoring manual provides several examples, but none perfectly match the examinee's answer.
What is the most appropriate action for the psychometrist to take?