BMAT Assessment MCQ 5 — Questions and Answers
Question 1: Which of the following is the best strategy for reducing stereotype threat during a high-stakes assessment?
- Removing all time limits from the test
- Having students self-report their demographic group before the test
- Providing a brief values-affirmation writing task before the test (Correct answer)
- Increasing the number of test items to improve reliability
Correct answer: Providing a brief values-affirmation writing task before the test
Values-affirmation interventions before testing have been shown to buffer the negative impact of stereotype threat on performance.
Question 2: In item response theory (IRT), what does the 'discrimination parameter' represent?
- How difficult an item is for an average test-taker
- How well an item distinguishes between test-takers of different ability levels (Correct answer)
- The probability of guessing correctly at random
- The standard deviation of item responses
Correct answer: How well an item distinguishes between test-takers of different ability levels
The discrimination parameter in IRT indicates the slope of the item characteristic curve — steeper slopes mean the item better distinguishes between ability levels.
Question 3: A teacher wants to assess whether students have the prerequisite knowledge needed before beginning a new unit. Which type of assessment should be used?
- Summative assessment
- Diagnostic assessment (Correct answer)
- Norm-referenced assessment
- Portfolio assessment
Correct answer: Diagnostic assessment
Diagnostic assessment identifies students' prior knowledge and gaps before instruction begins so teaching can be tailored accordingly.
Question 4: Which of the following is a key characteristic of high-stakes assessments?
- Results are used only for teacher professional development
- Outcomes have significant consequences for students or institutions (Correct answer)
- They are always formative in nature
- They can only be administered by external agencies
Correct answer: Outcomes have significant consequences for students or institutions
High-stakes assessments carry major consequences such as graduation, university admission, or school accountability ratings.
Question 5: A researcher compares BMAT scores with first-year medical school GPA obtained at the same time. This is an example of:
- Predictive validity
- Concurrent validity (Correct answer)
- Content validity
- Face validity
Correct answer: Concurrent validity
Concurrent validity is established when a test correlates with another measure of the same construct collected at approximately the same time.
Question 6: Which of the following most accurately describes 'washback effect' in assessment?
- The influence of assessment results on subsequent test design
- The effect that a test has on teaching and learning practices (Correct answer)
- The statistical adjustment of scores after testing
- The reuse of old test items in new assessments
Correct answer: The effect that a test has on teaching and learning practices
Washback (also called backwash) refers to how an assessment influences the curriculum, instruction, and study behaviors that precede it.
Question 7: Which of the following scenarios demonstrates high inter-rater reliability?
- Two graders assign very different scores to the same essay
- The same grader gives consistent scores across sessions weeks apart
- Two independent graders assign nearly identical scores to the same essay (Correct answer)
- A test produces the same total score when items are randomly reordered
Correct answer: Two independent graders assign nearly identical scores to the same essay
Inter-rater reliability is high when independent scorers agree closely on their ratings of the same response.
Which of the following is the best strategy for reducing stereotype threat during a high-stakes assessment?