CBT Test Assembly and Delivery 3 — Questions and Answers
Question 1: What is the role of a 'proctor workstation' that is distinct from an examinee workstation in a CBT center?
- It administers a harder version of the exam
- It allows the proctor to monitor examinee status, launch tests, and handle incidents (Correct answer)
- It stores the encrypted item bank locally
- It grades and scores tests in real time
Correct answer: It allows the proctor to monitor examinee status, launch tests, and handle incidents
The proctor workstation provides administrative control, letting staff monitor test-taking status, authorize starts, and log incidents without accessing item content.
Question 2: Which data element is most critical to capture at check-in to maintain test security and examinee identity verification?
- Examinee's preferred test language
- Biometric or government-issued photo ID matched to registration (Correct answer)
- Examinee's prior test scores
- The testing center's daily capacity log
Correct answer: Biometric or government-issued photo ID matched to registration
Verifying a government-issued photo ID against registration records is the cornerstone of identity verification and test security at check-in.
Question 3: A candidate's CBT session crashes mid-exam and data is lost. Which system feature is designed to recover the session without compromising security?
- Automatic re-administration of the full test
- Checkpoint/resume functionality that restores responses from the last saved state (Correct answer)
- Manual re-entry of answers by the proctor
- Issuing a new form from scratch
Correct answer: Checkpoint/resume functionality that restores responses from the last saved state
Checkpoint/resume (session recovery) saves response state at intervals so an interrupted test can continue from the last valid point.
Question 4: Item parameter drift over time in a CBT bank is best detected through:
- Increasing item exposure rates
- Periodic linking studies or differential item functioning analyses across administrations (Correct answer)
- Reducing the item pool size
- Extending the testing window
Correct answer: Periodic linking studies or differential item functioning analyses across administrations
Linking studies and DIF analyses across successive administrations detect whether item parameters have shifted, signaling potential compromise or population changes.
Question 5: What is the purpose of 'seeding' operational CBT forms with unscored pilot items?
- To increase the total test length for examinees
- To collect statistical data on new items under real testing conditions without affecting scores (Correct answer)
- To replace retired items immediately
- To identify cheating by tracking unusual response patterns
Correct answer: To collect statistical data on new items under real testing conditions without affecting scores
Seeded pilot items gather real-condition calibration data needed to estimate item parameters before an item is used operationally.
Question 6: In CBT delivery, 'secure browser' software primarily prevents:
- Network latency during item loading
- Examinees from accessing outside applications, websites, or copying content during testing (Correct answer)
- Scoring errors in constructed-response items
- Item randomization from being overridden
Correct answer: Examinees from accessing outside applications, websites, or copying content during testing
Secure browser lockdown technology restricts access to unauthorized applications and the internet, maintaining test integrity on the examinee's device.
Question 7: Which psychometric property should be verified for each assembled CBT form before operational delivery?
- Item mean response time
- Reliability estimate and score scale alignment with the established passing standard (Correct answer)
- Number of graphics per item
- Geographic distribution of test centers
Correct answer: Reliability estimate and score scale alignment with the established passing standard
Confirming reliability and alignment with the score scale ensures each form measures with adequate precision and that scores are comparable across administrations.
CBT Test Assembly and Delivery 3
What is the role of a 'proctor workstation' that is distinct from an examinee workstation in a CBT center?