GAT Evaluation Format 3 — Questions and Answers
Question 1: The GAT uses 'equating' across different test forms. The primary goal of equating is to:
- Make all test forms identical
- Ensure scores from different forms reflect the same level of ability (Correct answer)
- Increase the number of test questions
- Replace standardized scoring with raw scores
Correct answer: Ensure scores from different forms reflect the same level of ability
Equating adjusts for differences in difficulty between test forms so scores remain comparable.
Question 2: Which of the following is an example of a 'constructed-response' item on the GAT?
- Selecting the correct synonym from four choices
- Writing a short explanation of a passage's main idea (Correct answer)
- Marking true or false for a statement
- Ranking four events in chronological order
Correct answer: Writing a short explanation of a passage's main idea
Constructed-response items require test-takers to produce their own written answer rather than select from options.
Question 3: If a GAT test section has a 'do-not-return' policy, it means:
- Test-takers may not retake that section
- Once a test-taker moves forward, they cannot revisit previous questions (Correct answer)
- Scores from that section are not included in the final result
- Questions from that section are never reused
Correct answer: Once a test-taker moves forward, they cannot revisit previous questions
A do-not-return policy prevents test-takers from going back to review or change earlier answers.
Question 4: GAT score reports often include a 'standard error of measurement (SEM).' SEM is used to:
- Identify cheating patterns
- Express the range within which a test-taker's true score likely falls (Correct answer)
- Calculate the raw score from responses
- Compare two different test formats
Correct answer: Express the range within which a test-taker's true score likely falls
SEM indicates the uncertainty in a score, showing the interval where the true ability score likely lies.
Question 5: A GAT evaluation uses 'matrix sampling,' meaning each test-taker answers only a subset of the total item pool. This approach is used to:
- Reduce test validity
- Cover a broader range of content without overburdening individual test-takers (Correct answer)
- Ensure all test-takers answer the same questions
- Eliminate the need for scoring rubrics
Correct answer: Cover a broader range of content without overburdening individual test-takers
Matrix sampling distributes different subsets of items across test-takers to assess wide content coverage efficiently.
Question 6: In the context of GAT evaluation formats, 'face validity' refers to:
- Whether the test actually measures what it claims to measure statistically
- Whether the test appears relevant and appropriate to test-takers on the surface (Correct answer)
- The accuracy of the answer key
- The number of items per section
Correct answer: Whether the test appears relevant and appropriate to test-takers on the surface
Face validity is the perception that a test looks like it measures what it's intended to measure, even if not statistically confirmed.
Question 7: A test section on the GAT includes both 'anchor items' and 'operational items.' Anchor items are used to:
- Provide extra points for high scorers
- Link different test forms for score equating (Correct answer)
- Replace missing answers automatically
- Penalize guessing on hard questions
Correct answer: Link different test forms for score equating
Anchor items appear across multiple test forms and serve as reference points for equating scores between forms.
GAT Evaluation Format 3
The GAT uses 'equating' across different test forms.
The primary goal of equating is to: