NHEEE Scoring and Evaluation 3 — Questions and Answers
Question 1: On the NHEEE, inter-rater reliability refers to:
- Consistency of a student's scores across multiple attempts
- Agreement between two or more scorers evaluating the same response (Correct answer)
- The correlation between NHEEE scores and college GPA
- The accuracy of automated answer-key scanning
Correct answer: Agreement between two or more scorers evaluating the same response
Inter-rater reliability measures the degree to which different human scorers assign the same score to the same student response.
Question 2: Which score scale is most commonly used to report NHEEE results to colleges?
- Raw score only
- A scaled score on a fixed numeric range (Correct answer)
- A letter grade (A–F)
- A simple pass/fail designation
Correct answer: A scaled score on a fixed numeric range
NHEEE scores are reported on a standardized scaled score range so they can be meaningfully compared across administrations.
Question 3: What distinguishes norm-referenced scoring from criterion-referenced scoring?
- Norm-referenced scoring compares students to each other; criterion-referenced measures mastery of defined standards (Correct answer)
- Norm-referenced scoring awards points for each correct answer; criterion-referenced uses essays only
- Norm-referenced scoring is used for math; criterion-referenced is used for reading
- They are identical processes with different names
Correct answer: Norm-referenced scoring compares students to each other; criterion-referenced measures mastery of defined standards
Norm-referenced scores rank students relative to peers, while criterion-referenced scores measure performance against a fixed content standard.
Question 4: If a student requests a score verification after receiving NHEEE results, the testing authority will typically:
- Allow the student to retake the exam for free
- Rescan or re-hand-score the student's answer document (Correct answer)
- Adjust the score upward by one standard deviation
- Send the score directly to the student's first-choice college only
Correct answer: Rescan or re-hand-score the student's answer document
Score verification involves reviewing the original answer document for scanning errors or hand-scoring discrepancies.
Question 5: A student's NHEEE subscores show strength in algebra but weakness in geometry. How should this information be used?
- It should be ignored because only the composite score matters
- It can guide targeted study and inform placement decisions (Correct answer)
- It automatically disqualifies the student from STEM programs
- It replaces the composite score on the official report
Correct answer: It can guide targeted study and inform placement decisions
Subscores provide diagnostic detail that students can use for targeted preparation and that colleges can use for placement.
Question 6: What is the effect of 'score compression' at the top of the NHEEE scale?
- High-scoring students receive bonus points
- Small raw-score differences produce large scaled-score changes
- Many students cluster near the maximum score, reducing score spread (Correct answer)
- Top scorers are automatically ranked above peers with the same score
Correct answer: Many students cluster near the maximum score, reducing score spread
Score compression means that many high-performing students receive scores close to the ceiling, making it harder to distinguish among them.
Question 7: Which validity evidence is most directly relevant to whether the NHEEE measures what it claims to measure?
- Concurrent validity
- Content validity (Correct answer)
- Predictive validity
- Face validity
Correct answer: Content validity
Content validity evaluates how well the test items represent the full domain of knowledge and skills the exam is intended to assess.
NHEEE Scoring and Evaluation 3
On the NHEEE, inter-rater reliability refers to: