CBT MCQ 5 — Questions and Answers
Question 1: What is 'recency bias' in the context of MCQ answer selection, and how can you guard against it?
- Favoring the last answer choice read; guard against it by re-reading all options before selecting (Correct answer)
- Favoring topics studied most recently; guard against it by reviewing all content equally
- Selecting answers that match recent news events; guard against it by relying only on course material
- Preferring short answers because they are processed last; guard against it by measuring answer length
Correct answer: Favoring the last answer choice read; guard against it by re-reading all options before selecting
Recency bias causes test-takers to disproportionately favor the last option they read; deliberately reviewing all choices equalizes consideration.
Question 2: In CBT scoring, what does a 'scaled score' represent?
- The raw number of questions answered correctly
- A statistically adjusted score that accounts for variation in difficulty across exam forms (Correct answer)
- The percentage of time spent on each question
- A score multiplied by the question's point value
Correct answer: A statistically adjusted score that accounts for variation in difficulty across exam forms
Scaled scores use a mathematical transformation to ensure fairness across different exam versions so that a 700 on one form equals a 700 on another, regardless of item difficulty.
Question 3: When a CBT question asks for the step that should occur 'first' in a process, what is the most reliable approach?
- Select the step that sounds most important overall
- Identify the foundational or prerequisite step that must logically precede all others (Correct answer)
- Choose the step listed first in the answer choices
- Pick the step that takes the longest to complete
Correct answer: Identify the foundational or prerequisite step that must logically precede all others
Sequencing questions require identifying the step that is a prerequisite for all others, which is the true first action in the correct order of operations.
Question 4: What role does 'standard setting' play in determining the passing score for a CBT certification exam?
- It sets the timer based on average candidate completion speed
- A panel of subject matter experts determines the minimum score that demonstrates acceptable competency (Correct answer)
- The passing score is set at 70% correct answers by default across all exams
- Passing scores are determined solely by the statistical average of all test-takers
Correct answer: A panel of subject matter experts determines the minimum score that demonstrates acceptable competency
Standard setting methods, such as the Angoff or Bookmark method, use expert judgment to define the minimally competent candidate's expected performance.
Question 5: Which test-taking error occurs when a test-taker selects an answer that is true in general but does not specifically address the question being asked?
- Miskeying
- Selecting a true-but-irrelevant distractor (Correct answer)
- Committing a Type I error
- Answer key bias
Correct answer: Selecting a true-but-irrelevant distractor
A true-but-irrelevant distractor is factually correct in isolation but fails to answer the specific question, making it an incorrect choice in context.
Question 6: A CBT exam uses 'pretest items' mixed in with scored questions. What is their purpose?
- They serve as rest breaks and are visually formatted differently from scored items
- They are unscored pilot questions used to gather statistical data for potential future exam use (Correct answer)
- They are bonus questions that award extra credit if answered correctly
- They replace scored questions when a technical error is detected
Correct answer: They are unscored pilot questions used to gather statistical data for potential future exam use
Pretest items are experimental questions that look identical to scored items; their performance data is analyzed to determine if they meet psychometric standards before being added to scored item pools.
Question 7: How does 'test security' in a CBT environment protect the integrity of standardized exams?
- By displaying questions in a random font to prevent photography
- Through measures such as unique item pools per candidate, NDA agreements, biometric check-in, and secure browser lockdown (Correct answer)
- By prohibiting candidates from taking the exam more than once
- By having a human proctor manually grade each answer in real time
Correct answer: Through measures such as unique item pools per candidate, NDA agreements, biometric check-in, and secure browser lockdown
CBT security combines unique item delivery, legal agreements, identity verification, and technical controls to prevent item exposure and unauthorized access.
CBT MCQ 5
What is 'recency bias' in the context of MCQ answer selection, and how can you guard against it?