CBT Random 4 — Questions and Answers
Question 1: What is 'response time analysis' used for in CBT security?
- To measure how long the testing center was open
- To detect patterns such as unusually fast responses that may indicate pre-knowledge of answers (Correct answer)
- To calculate the average exam completion time for reporting purposes
- To bill candidates based on time spent in the testing center
Correct answer: To detect patterns such as unusually fast responses that may indicate pre-knowledge of answers
Analyzing how quickly candidates answer each question can reveal suspicious patterns that suggest answer sharing or access to actual exam content.
Question 2: Which adaptive testing model selects the next question based solely on whether the previous answer was correct or incorrect?
- 3PL item response theory model
- Simple up-down staircase method (Correct answer)
- Multidimensional adaptive testing
- Fixed linear routing
Correct answer: Simple up-down staircase method
The staircase (or up-down) method increases difficulty after a correct answer and decreases it after an incorrect one in a straightforward sequential pattern.
Question 3: What type of CBT item requires a candidate to click directly on a specific area of an image to answer correctly?
- Essay question
- Hot spot item (Correct answer)
- Matching item
- Ordered-response item
Correct answer: Hot spot item
Hot spot items display an image and ask candidates to click on the correct region, testing visual recognition and applied knowledge.
Question 4: In CBT administration, what does NDA stand for and why must candidates sign one?
- Non-Disclosure Agreement; to prevent sharing of exam content (Correct answer)
- Network Data Authorization; to allow remote access during testing
- Numeric Data Algorithm; to validate answers electronically
- National Diagnostic Assessment; to comply with federal regulations
Correct answer: Non-Disclosure Agreement; to prevent sharing of exam content
Candidates sign a Non-Disclosure Agreement to legally prohibit them from reproducing or sharing exam questions, protecting the integrity of the item bank.
Question 5: What is the role of 'item exposure control' in computer adaptive testing?
- To limit the number of candidates who see any single item, reducing overuse and compromise risk (Correct answer)
- To display every item to every candidate to ensure fairness
- To increase the brightness of the screen when hard questions appear
- To expose candidates to items outside their ability range for challenge
Correct answer: To limit the number of candidates who see any single item, reducing overuse and compromise risk
Exposure control algorithms limit how frequently a specific item appears across administrations to prevent it from becoming widely known and compromised.
Question 6: Which of the following personal items is MOST commonly prohibited inside a CBT testing room?
- Eyeglasses
- A wristwatch with a digital display (Correct answer)
- Earplugs provided by the testing center
- A pencil provided by the proctor
Correct answer: A wristwatch with a digital display
Smartwatches and digital watches with memory or communication capability are banned because they could be used to store or transmit exam content.
Question 7: What is 'differential item functioning' (DIF) analysis used for in CBT development?
- Determining which items load fastest on the testing interface
- Identifying questions that perform differently across demographic groups, signaling potential bias (Correct answer)
- Calculating the cost of delivering each item to candidates
- Ranking items from easiest to hardest for adaptive routing
Correct answer: Identifying questions that perform differently across demographic groups, signaling potential bias
DIF analysis detects items where candidates of equal ability from different groups answer at different rates, which can indicate bias and requires expert review.
CBT Random 4
What is 'response time analysis' used for in CBT security?