BCP Test Security and Integrity 3 — Questions and Answers
Question 1: A psychometrist discovers that test booklets from a previous administration were not shredded as required. What should be done FIRST?
- Shred the materials immediately without reporting the lapse
- Secure the materials and report the lapse to the testing program per protocol (Correct answer)
- Return the booklets to candidates who used them
- Reuse the booklets for the next administration to avoid waste
Correct answer: Secure the materials and report the lapse to the testing program per protocol
Securing remaining materials and reporting the security lapse allows the organization to assess risk and determine if score validity was compromised.
Question 2: Identity verification before a high-stakes exam is primarily intended to prevent:
- Examinees from arriving late
- Proxy testing, where someone takes the exam on behalf of the registered candidate (Correct answer)
- Examinees from bringing prohibited materials
- Excessive retake attempts
Correct answer: Proxy testing, where someone takes the exam on behalf of the registered candidate
Rigorous ID checks ensure the person sitting for the exam is the registered candidate, preventing fraudulent score attribution through proxy testing.
Question 3: Which of the following is an example of a 'proactive' test security measure rather than a 'reactive' one?
- Score cancellation after a breach is confirmed
- Conducting a post-hoc erasure analysis
- Using multiple test forms with different item sequences (Correct answer)
- Investigating an examinee flagged by a proctor
Correct answer: Using multiple test forms with different item sequences
Using multiple test forms reduces the benefit of copying or advance item exposure before a breach occurs, making it a proactive deterrent.
Question 4: Under federal testing standards, accommodations provided for a disability must not:
- Alter the time limits for the examination
- Give the examinee an unfair advantage on the construct being measured (Correct answer)
- Require additional documentation from the examinee
- Be provided in a separate testing room
Correct answer: Give the examinee an unfair advantage on the construct being measured
Accommodations must remove barriers related to the disability without providing advantages on the skills or knowledge the test is designed to measure.
Question 5: A proctor suspects an examinee has memorized and is reconstructing test items after the exam. This practice is known as:
- Answer copying
- Braindumping (Correct answer)
- Differential item functioning
- Item parameter drift
Correct answer: Braindumping
Braindumping involves reconstructing and distributing test content from memory, which compromises future test security and fairness.
Question 6: When a test is administered on a computer, which security feature helps verify that remote testing candidates are not receiving unauthorized assistance?
- Adaptive item sequencing
- Remote proctoring with AI-based behavior monitoring and live proctor oversight (Correct answer)
- Automatic score reporting
- Dynamic item generation
Correct answer: Remote proctoring with AI-based behavior monitoring and live proctor oversight
Remote proctoring combines behavioral monitoring technology and human oversight to detect and deter unauthorized aid during unproctored administrations.
Question 7: Which of the following poses the GREATEST threat to long-term item bank security in a computerized adaptive test (CAT)?
- Item calibration drift over time
- Rapid exposure of high-information items to many examinees (Correct answer)
- Inconsistent scoring rubrics
- Network latency during administration
Correct answer: Rapid exposure of high-information items to many examinees
High-information items in a CAT are administered frequently; if over-exposed, they can be memorized and shared, compromising future score validity.
A psychometrist discovers that test booklets from a previous administration were not shredded as required.
What should be done FIRST?