ATP Technology & Digital Applications 4 — Questions and Answers
Question 1: What is the primary advantage of using AI-powered automated essay scoring (AES) in large-scale digital assessments?
- It eliminates all need for content validity evidence
- It enables rapid, consistent scoring of thousands of responses at lower cost (Correct answer)
- It outperforms human raters in detecting construct-irrelevant variance
- It removes the need for rubric development
Correct answer: It enables rapid, consistent scoring of thousands of responses at lower cost
AES systems can score large volumes of essays quickly and consistently, significantly reducing the time and cost compared to human scoring at scale.
Question 2: In digital test delivery, what does 'data encryption at rest' protect against?
- Interception of data while it travels over a network
- Unauthorized access to stored item content or candidate data on a server or device (Correct answer)
- Browser-based cross-site scripting attacks
- Denial-of-service attacks on testing servers
Correct answer: Unauthorized access to stored item content or candidate data on a server or device
Encryption at rest protects stored data so that even if physical storage media or database files are accessed without authorization, the content remains unreadable.
Question 3: Which feature of modern item authoring tools most directly supports collaborative test development across geographically distributed teams?
- Offline XML export of item content
- Cloud-based concurrent editing with version control and review workflows (Correct answer)
- PDF proof generation for item review committees
- Automated item difficulty prediction
Correct answer: Cloud-based concurrent editing with version control and review workflows
Cloud-based authoring platforms allow distributed teams to simultaneously create, edit, and review items with full version history and workflow routing.
Question 4: What is 'biometric authentication' used for in high-stakes digital testing?
- Adjusting screen brightness based on ambient light during the exam
- Verifying a candidate's identity using unique physical characteristics such as fingerprints or facial recognition (Correct answer)
- Encrypting exam responses using the candidate's biological signature
- Measuring physiological stress to flag potential cheating
Correct answer: Verifying a candidate's identity using unique physical characteristics such as fingerprints or facial recognition
Biometric authentication verifies that the person taking the exam matches the registered candidate, helping prevent proxy testing.
Question 5: A testing program experiences a server outage during a high-stakes exam window. Which infrastructure approach best mitigates this risk?
- Storing all exam content locally on candidate devices without server dependency
- Deploying redundant servers with automatic failover across multiple data centers (Correct answer)
- Requiring candidates to retest at a later date with the same form
- Using paper-based backup forms kept at test centers
Correct answer: Deploying redundant servers with automatic failover across multiple data centers
Redundant servers with automatic failover ensure that if one data center fails, traffic is routed to another, maintaining exam availability.
Question 6: In digital scoring systems, what is the purpose of 'inter-rater reliability' monitoring even when automated scoring is used?
- To calibrate the AES engine against human judgment and detect model drift (Correct answer)
- To ensure all raters are paid equally for their work
- To assign final scores based on the highest rater's evaluation
- To prevent human raters from reviewing AI-scored responses
Correct answer: To calibrate the AES engine against human judgment and detect model drift
Comparing automated scores to human scores detects model drift or bias in the AES engine and ensures scoring quality is maintained over time.
Question 7: Which digital assessment technology captures a candidate's eye movements to infer whether they are looking away from the screen during an exam?
- Keystroke dynamics analysis
- Gaze tracking (eye-tracking proctoring) (Correct answer)
- Audio environment monitoring
- Screen sharing analysis
Correct answer: Gaze tracking (eye-tracking proctoring)
Gaze tracking uses the device camera to monitor where the candidate's eyes are directed, flagging extended off-screen gaze as a potential integrity concern.
ATP Technology & Digital Applications 4
What is the primary advantage of using AI-powered automated essay scoring (AES) in large-scale digital assessments?