CBT Introduction to CBT 3 — Questions and Answers
Question 1: What does 'test form equating' accomplish in large-scale CBT programs?
- It makes all test forms identical
- It ensures scores from different test versions are comparable (Correct answer)
- It equalizes the number of questions across subjects
- It balances the time limit between different candidates
Correct answer: It ensures scores from different test versions are comparable
Equating is a statistical process that adjusts for differences in difficulty between test forms so that a score of, say, 75 means the same thing regardless of which form a candidate took.
Question 2: Which of the following is NOT a typical feature of a modern CBT platform?
- Flagging questions for review
- Automatic handwriting recognition (Correct answer)
- Built-in countdown timer
- On-screen calculator
Correct answer: Automatic handwriting recognition
Standard CBT platforms do not use handwriting recognition because candidates respond via keyboard or mouse, not by writing.
Question 3: In CBT terminology, what is a 'pretest item'?
- A practice question shown before the real exam begins
- An unscored experimental question embedded to gather statistical data (Correct answer)
- The first question of every exam section
- A question used exclusively in adaptive tests
Correct answer: An unscored experimental question embedded to gather statistical data
Pretest (or pilot) items are unscored questions mixed into a live exam to collect response data for future use, without affecting the candidate's score.
Question 4: Why might a testing organization require candidates to complete a tutorial before starting a CBT exam?
- To teach candidates the subject matter
- To familiarize candidates with the interface so navigation issues don't affect scores (Correct answer)
- To collect demographic information
- To allow the system to calibrate difficulty
Correct answer: To familiarize candidates with the interface so navigation issues don't affect scores
Pre-exam tutorials ensure every candidate understands how to navigate, flag items, and use on-screen tools so unfamiliarity with the software does not disadvantage anyone.
Question 5: What is the role of psychometrics in CBT development?
- Designing the graphical user interface
- Applying psychological measurement science to ensure validity and reliability (Correct answer)
- Writing question content and answer choices
- Managing network infrastructure for test delivery
Correct answer: Applying psychological measurement science to ensure validity and reliability
Psychometricians apply measurement theory to evaluate item quality, set passing scores, equate forms, and ensure a CBT accurately measures the intended knowledge or skills.
Question 6: A candidate receives a 'scaled score' on a CBT. What does this mean?
- The score was adjusted based on how long the candidate took
- The raw score has been converted to a common numeric scale for comparability (Correct answer)
- The score reflects only the hardest questions answered correctly
- The candidate's score was compared only to others in the same room
Correct answer: The raw score has been converted to a common numeric scale for comparability
Scaling transforms raw scores onto a standardized reporting scale so that scores from different test forms or administrations can be meaningfully compared.
Question 7: Which scenario best illustrates a threat to CBT security known as 'harvesting'?
- A candidate finishing the exam early
- A test-taker memorizing questions during the exam and sharing them online afterward (Correct answer)
- A network failure causing exam data loss
- A proctor reviewing scores before candidates leave
Correct answer: A test-taker memorizing questions during the exam and sharing them online afterward
Harvesting refers to candidates deliberately memorizing live exam items and reporting them to brain-dump websites, compromising the integrity of the item bank.
CBT Introduction to CBT 3
What does 'test form equating' accomplish in large-scale CBT programs?