Computer-Based Testing (CBT) Knowledge Assessment — Questions and Answers
Question 1: Which reading technique is most effective for long MCQ stems on a CBT exam?
- Skip reading and guess based on keywords
- Read only the answer choices first to save time
- Read the entire stem carefully before looking at the answer choices (Correct answer)
- Read the last sentence of the stem first, then skim options
Correct answer: Read the entire stem carefully before looking at the answer choices
Reading the full stem before viewing options ensures you understand the question's exact requirements and avoids anchoring bias from answer choices.
Question 2: A CBT score report for a certification exam includes a 'score validity period.' What does this communicate?
- The period a candidate must wait before retesting
- The deadline to receive score reports after testing
- The dates the test center is open for testing
- The time window during which the score is officially recognized for credentialing purposes (Correct answer)
Correct answer: The time window during which the score is officially recognized for credentialing purposes
A score validity period specifies how long the score is accepted for credentialing decisions, after which the candidate must retest because knowledge in the field may have changed.
Question 3: A physical test center is being set up for high-stakes CBT certification exams. Which of the following security measures is MOST critical for preventing candidates from bringing in unauthorized materials?
- Playing ambient background music to mask potential whispering.
- Requiring candidates to store all personal belongings in a secure locker outside the testing room. (Correct answer)
- Offering complimentary coffee and snacks in the waiting area.
- Ensuring comfortable seating and adequate lighting at each workstation.
Correct answer: Requiring candidates to store all personal belongings in a secure locker outside the testing room.
The most effective measure to prevent the introduction of unauthorized materials like notes, phones, or other devices is to prohibit them from entering the testing room entirely. Providing secure, individual storage, such as lockers, for all personal items before a candidate enters the controlled testing environment is a fundamental physical security requirement for test centers.
Question 4: A candidate's score report for a certification exam indicates their scaled score is 750, with a passing score of 700. The report also shows a Standard Error of Measurement (SEM) of 25. What does the SEM indicate?
- The percentile rank of the candidate compared to a reference group.
- The range within which the candidate's 'true score' likely falls. (Correct answer)
- The percentage of questions the candidate answered correctly.
- The candidate's score is 25 points above the average score of all test-takers.
Correct answer: The range within which the candidate's 'true score' likely falls.
The Standard Error of Measurement (SEM) quantifies the amount of error in a test score. It is used to create a confidence interval, or a range of scores, that likely contains the candidate's true score (the score they would get if there were no measurement error). It does not directly relate to the average score, percentage correct, or percentile rank.
Question 5: A testing center proctor discovers that two candidates sitting adjacent to each other submitted nearly identical answers on a high-stakes exam. The ethical obligation of the testing organization is to:
- Immediately pass scores to clients while flagging internally
- Automatically void both candidates' results without investigation
- Ignore it since the exam is already over
- Investigate the irregularity before releasing scores (Correct answer)
Correct answer: Investigate the irregularity before releasing scores
Ethical standards require a proper investigation into suspected misconduct before any adverse action is taken or scores are released.
Question 6: Which WCAG 2.1 conformance level is generally required for CBT platforms used in high-stakes testing?
- Level A only
- No standard applies
- Level AA (Correct answer)
- Level AAA
Correct answer: Level AA
WCAG 2.1 Level AA is the standard required by most legal frameworks and testing organizations for digital accessibility compliance.
Question 7: A CBT exam includes timed simulation tasks. A candidate with a motor disability receives 50% extended time. How should the extended time apply to the timed simulation segments?
- Only to the reading and multiple-choice portions, not simulations
- The candidate is exempt from all simulation tasks
- Proportionally to simulation tasks as well, unless doing so fundamentally alters the simulation construct (Correct answer)
- The simulation clock is paused indefinitely until the candidate is ready
Correct answer: Proportionally to simulation tasks as well, unless doing so fundamentally alters the simulation construct
Extended time should apply proportionally to all timed exam components unless extending time on a specific task would change what the task is designed to measure.
Question 8: What does 'form assembly' mean in CBT test design?
- Physically assembling test booklets
- Selecting and organizing items into a deliverable test that meets blueprint constraints (Correct answer)
- Printing test results for candidates
- Training item writers to create new questions
Correct answer: Selecting and organizing items into a deliverable test that meets blueprint constraints
Form assembly is the process of selecting items from the item bank and arranging them into a complete test that satisfies all content, statistical, and format requirements.
Question 9: When reviewing a test blueprint for legal defensibility, which element is most important to verify?
- The color scheme of the test interface
- That domain weights are empirically tied to JTA criticality data (Correct answer)
- That the test was translated into multiple languages
- That the test was developed within budget
Correct answer: That domain weights are empirically tied to JTA criticality data
Legal defensibility requires that blueprint domain weights can be traced to documented JTA findings showing the relative importance of each content area for job performance.
Question 10: When designing a score report for candidates who did not pass a CBT exam, which component is MOST valuable for guiding their future study efforts?
- A list of the specific questions the candidate answered incorrectly.
- The candidate's percentile rank compared to all other test-takers.
- The candidate's overall scaled score and the required passing score.
- Diagnostic feedback showing performance by major content domains or sections. (Correct answer)
Correct answer: Diagnostic feedback showing performance by major content domains or sections.
While the overall score indicates the result, diagnostic feedback broken down by content areas (e.g., domains, objectives) provides actionable information. It helps candidates identify their specific areas of weakness so they can focus their remediation efforts effectively. Providing specific incorrect questions is often avoided to protect item security, and percentile rank is less useful for targeted study.
Question 11: Which technology enables a candidate to take a proctored CBT exam from home in the US?
- Telephone-based verification systems
- Virtual reality headsets
- Paper score sheets mailed after the exam
- Remote online proctoring (ROP) using webcam, microphone, and AI monitoring software (Correct answer)
Correct answer: Remote online proctoring (ROP) using webcam, microphone, and AI monitoring software
Remote online proctoring uses webcam feeds, AI behavioral analysis, and human proctors to supervise candidates in their own environment.
Question 12: Which of the following best describes the 'secure browser' technology used in CBT exams?
- A browser with faster loading speeds optimized for exam content delivery
- A locked-down application that prevents candidates from accessing other programs, websites, or system functions during testing (Correct answer)
- An encrypted connection between the candidate's computer and the exam server
- A browser plugin that records the candidate's webcam feed
Correct answer: A locked-down application that prevents candidates from accessing other programs, websites, or system functions during testing
Secure browsers create a controlled testing environment by disabling access to outside applications, search engines, and system utilities during the exam.
Question 13: When developing a case study or 'testlet' item set, which authoring principle is MOST important?
- Testlets must contain at least ten items to justify the shared stimulus length
- Items within the set must be independent of each other's answers while sharing the common stimulus (Correct answer)
- The stimulus should be written after the items to ensure alignment
- Each item in the set must require information from all preceding items to answer
Correct answer: Items within the set must be independent of each other's answers while sharing the common stimulus
Item independence within a testlet prevents correct answers from depending on previous item responses, preserving valid scoring.
Question 14: A CBT exam shows a progress bar indicating you have used 70% of your time but completed only 50% of questions. What is the best immediate action?
- Increase your pace and spend less time on remaining questions (Correct answer)
- Submit the exam immediately
- Continue at the same pace and trust you will finish
- Stop and review your flagged questions first
Correct answer: Increase your pace and spend less time on remaining questions
When time usage significantly outpaces question completion, you must accelerate your pace to avoid running out of time.
Question 15: Which of the following BEST describes 'content balancing' during automated test assembly from an item bank?
- Ensuring each test form uses exactly the same items as the previous form
- Selecting items so each form matches the blueprint's specified proportion of content domains and cognitive levels (Correct answer)
- Randomly selecting items from the bank without any constraints
- Weighting difficult items more heavily to reward advanced candidates
Correct answer: Selecting items so each form matches the blueprint's specified proportion of content domains and cognitive levels
Content balancing ensures every assembled form is parallel in terms of blueprint coverage, supporting score comparability across forms.
Question 16: What is the purpose of a 'candidate anomaly flag' generated by AI proctoring software?
- It automatically voids the exam when cheating is confirmed
- It notifies the candidate that their behavior is being monitored
- It records when a candidate's performance drops significantly mid-exam
- It alerts a human reviewer to review specific segments of a session where suspicious behavior was detected (Correct answer)
Correct answer: It alerts a human reviewer to review specific segments of a session where suspicious behavior was detected
AI flags are triggers for human review rather than automatic enforcement actions, ensuring human judgment is applied before any disciplinary decision.
Question 17: What is the purpose of caching exam content locally on a CBT workstation before the exam begins?
- To allow candidates to preview questions early
- To speed up AI scoring algorithms
- To ensure the exam continues uninterrupted if internet connectivity is temporarily lost (Correct answer)
- To sync scores to the cloud in real time
Correct answer: To ensure the exam continues uninterrupted if internet connectivity is temporarily lost
Pre-caching delivers encrypted content to the local machine so the exam session can continue during brief network outages without exposing plaintext items.
Question 18: How should a candidate interpret a 'Pass' result on a criterion-referenced CBT exam in the US?
- They scored higher than 50% of other candidates
- They met the minimum competency standard set by the exam authority, regardless of peer performance (Correct answer)
- They placed in the top quartile of all examinees
- They answered every question correctly
Correct answer: They met the minimum competency standard set by the exam authority, regardless of peer performance
Criterion-referenced exams measure performance against a fixed competency standard (cut score), not against how other candidates performed.
Question 19: What is the primary purpose of biometric verification at a CBT testing center?
- To speed up candidate check-in
- To record candidate performance data
- To comply with GDPR data requirements
- To confirm the candidate's identity matches the registered test-taker (Correct answer)
Correct answer: To confirm the candidate's identity matches the registered test-taker
Biometric verification ensures the person taking the exam is the same person who registered, preventing proxy testing.
Question 20: Why might a test design team include 'unscored tutorial items' at the start of a CBT?
- To familiarize candidates with item formats before scored questions begin (Correct answer)
- To measure baseline anxiety levels
- To collect demographic survey data
- To warm up the computer's processing speed
Correct answer: To familiarize candidates with item formats before scored questions begin
Tutorial items give candidates practice with the interface and item formats so that unfamiliarity with the technology does not disadvantage them on scored items.
Question 21: A test development team implements version control for items in the bank. What is the PRIMARY benefit of this practice?
- It speeds up item authoring by pre-populating metadata
- It preserves a history of changes so teams can revert to a prior version if a revision introduces errors (Correct answer)
- It automatically classifies items by cognitive level
- It prevents two authors from writing items on the same topic
Correct answer: It preserves a history of changes so teams can revert to a prior version if a revision introduces errors
Version control provides an audit trail of edits, allowing recovery of previous item text or metadata if a revision degrades item quality.
Question 22: In test blueprinting, 'content outline' and 'blueprint' are related because:
- The content outline is used only for essay exams
- The blueprint is created before the content outline
- The content outline describes what is tested while the blueprint adds item counts and weights (Correct answer)
- They are identical documents with different names
Correct answer: The content outline describes what is tested while the blueprint adds item counts and weights
The content outline lists the topics and subtopics to be assessed, while the blueprint builds on it by specifying how many items and at what cognitive level each topic is assessed.
Question 23: When must a CBT testing organization inform a candidate of an accommodation decision?
- Only if the accommodation is denied
- On the day of the exam
- With enough advance notice for the candidate to prepare or appeal (Correct answer)
- Within two business days after the exam
Correct answer: With enough advance notice for the candidate to prepare or appeal
Candidates must receive accommodation decisions well in advance so they can prepare assistive tools, appeal if necessary, or make alternative arrangements.
Question 24: Which of the following personal items is MOST commonly prohibited inside a CBT testing room?
- Eyeglasses
- Earplugs provided by the testing center
- A wristwatch with a digital display (Correct answer)
- A pencil provided by the proctor
Correct answer: A wristwatch with a digital display
Smartwatches and digital watches with memory or communication capability are banned because they could be used to store or transmit exam content.
Question 25: Which data format is most commonly used to exchange candidate and score data between CBT platforms and credentialing organizations?
- Fax transmission
- CSV emailed to administrators
- XML or JSON via secure API (Correct answer)
Correct answer: XML or JSON via secure API
Structured data formats like XML or JSON, transmitted via secured API endpoints, provide machine-readable, validated, and auditable data exchange between systems.
Question 26: A 'testlet' in CBT design refers to:
- A set of items sharing a common stimulus such as a scenario or passage (Correct answer)
- A single item type used throughout the test
- A very short 5-minute exam
- An optional bonus section
Correct answer: A set of items sharing a common stimulus such as a scenario or passage
A testlet is a cluster of items linked to one stimulus (e.g., a case study), which can introduce local item dependence that must be accounted for in scoring.
Question 27: A testing center's CCTV system fails on the morning of a scheduled exam. What is the appropriate action?
- Cancel all exams and reschedule for the next available date
- Notify the exam sponsor and determine whether additional proctoring measures can compensate before proceeding (Correct answer)
- Proceed with exams and note the outage in the incident log
- Allow candidates to self-proctor since staff are present
Correct answer: Notify the exam sponsor and determine whether additional proctoring measures can compensate before proceeding
A CCTV failure compromises a key security layer, so the exam sponsor must be notified and compensating controls assessed before exams proceed.
Question 28: During a proctored remote exam, a proctor flags a candidate for suspicious eye movement. Which platform feature allows the proctor to take immediate action without terminating the exam prematurely?
- Lowering the candidate's time limit remotely
- Proctor console with live chat, incident flag logging, and optional session pause/terminate controls (Correct answer)
- Automatic exam pause triggered by AI proctoring alerts
- Sending an automated email warning to the candidate
Correct answer: Proctor console with live chat, incident flag logging, and optional session pause/terminate controls
A proctor console with real-time controls lets proctors flag incidents, communicate with candidates, and pause or end sessions without waiting for automated triggers.
Question 29: A test center is located on the second floor with no elevator. A wheelchair user is scheduled for a CBT exam there. The CORRECT action is to:
- Offer the candidate a ground-floor hallway as a testing space
- Ask the candidate to reschedule for a later date when repairs are made
- Relocate the candidate to an accessible testing site without penalty or delay (Correct answer)
- Administer the exam remotely without any special authorization
Correct answer: Relocate the candidate to an accessible testing site without penalty or delay
The candidate must be accommodated at an accessible location under ADA requirements, with no penalty or additional burden placed on the candidate.
Question 30: A certification body is developing a new CBT exam for cybersecurity analysts. They convene a group of experienced professionals to identify the critical tasks, knowledge, and skills required for the job. This process is best described as:
- Standard Setting
- Item Analysis
- Beta Testing
- Job Task Analysis (JTA) (Correct answer)
Correct answer: Job Task Analysis (JTA)
A Job Task Analysis (JTA), also known as a practice analysis or role delineation study, is the process of defining the essential tasks and knowledge required for competent performance in a profession. The results of the JTA directly inform the development of the test blueprint.
Question 31: Why do testing organizations use item banks with large pools of questions rather than a single fixed exam form?
- To allow candidates to retake exams more frequently
- To comply with Americans with Disabilities Act requirements
- To reduce the cost of exam development
- To limit the damage caused by content exposure by ensuring no single leaked set can compromise all exam versions (Correct answer)
Correct answer: To limit the damage caused by content exposure by ensuring no single leaked set can compromise all exam versions
Large item banks allow testing organizations to generate multiple exam forms, so exposure of one form does not compromise the entire assessment program.
Question 32: During a remote proctored exam, a candidate's video feed cuts out for 45 seconds. What should the proctor do?
- Flag the incident and attempt to reconnect before making a determination (Correct answer)
- Award full credit and note technical difficulties
- Ignore it if the audio feed remains active
- Immediately terminate the exam
Correct answer: Flag the incident and attempt to reconnect before making a determination
Protocol requires the proctor to document the loss of visual contact and attempt to restore the connection before taking punitive action.
Question 33: What is a 'lockdown browser' used for in CBT environments?
- To record candidate keystrokes for adaptive scoring
- To speed up internet access during the exam
- To automatically grade open-ended responses
- To prevent candidates from accessing unauthorized websites or applications during a remotely proctored exam (Correct answer)
Correct answer: To prevent candidates from accessing unauthorized websites or applications during a remotely proctored exam
A lockdown browser restricts the test-taker's computer to the exam interface, blocking access to browsers, applications, and external sites to maintain security.
Question 34: Which of the following BEST describes the primary advantage of using scaled scores instead of raw scores for reporting results of a high-stakes CBT program with multiple test forms?
- They directly represent the number of questions answered correctly, providing transparent feedback.
- They allow for fair comparison of candidate performance across different, potentially unequally difficult, test forms. (Correct answer)
- Scaled scores are required for conducting item-level discrimination analysis.
- Scaled scores are easier for candidates to understand than raw percentages.
Correct answer: They allow for fair comparison of candidate performance across different, potentially unequally difficult, test forms.
The main purpose of scaling scores is to enable fair and direct comparisons of performance even when candidates take different versions (forms) of an exam that may have minor variations in difficulty. A raw score (number correct) on an easier form is not equivalent to the same raw score on a harder form. Scaling adjusts for this, ensuring that a specific scaled score signifies the same level of proficiency regardless of the form taken.
Question 35: In test center operations, 'throughput' refers to:
- The percentage of examinees who pass
- The number of examinees who can be tested per unit of time at a given facility (Correct answer)
- The speed at which items are scored
- The rate at which items are loaded from the server
Correct answer: The number of examinees who can be tested per unit of time at a given facility
Throughput measures testing center capacity — how many seats can be filled and completed per hour or day — affecting scheduling and appointment availability.
Question 36: A candidate requests 100% extended time due to ADHD. The testing organization denies this and offers 50% instead. Which statement best describes this decision?
- The candidate must receive exactly what they request
- Extended time is never appropriate for ADHD
- It is always illegal regardless of documentation
- It may be valid if supported by the candidate's documentation and clinical guidelines (Correct answer)
Correct answer: It may be valid if supported by the candidate's documentation and clinical guidelines
Testing organizations can determine appropriate accommodation levels based on submitted documentation and professional clinical standards.
Question 37: What is the benefit of using 'cloud-based' CBT infrastructure compared to on-premises servers?
- It removes the need for any internet connection
- It allows candidates to store their own exam questions
- It eliminates all security risks
- It provides elastic scalability to handle exam volume spikes without over-provisioning permanent hardware (Correct answer)
Correct answer: It provides elastic scalability to handle exam volume spikes without over-provisioning permanent hardware
Cloud infrastructure scales compute and storage resources on demand, accommodating sudden surges (e.g., a national certification exam day) without costly permanent hardware.
Question 38: When comparing two tests measuring the same construct, a correlation of r = 0.78 is found. This supports which type of validity evidence?
- Discriminant validity
- Convergent validity (Correct answer)
- Face validity
- Incremental validity
Correct answer: Convergent validity
Convergent validity evidence is demonstrated when a test correlates highly with other measures of the same or theoretically related constructs.
Question 39: What is 'answer pattern analysis' used for in post-exam security review?
- To measure the reliability of individual exam questions
- To rank candidates by performance for certification decisions
- To detect statistically improbable similarities between candidates' answers that suggest copying or collusion (Correct answer)
- To ensure all answer choices were selected equally across the candidate pool
Correct answer: To detect statistically improbable similarities between candidates' answers that suggest copying or collusion
Answer pattern analysis identifies pairs or groups of candidates whose responses are so similar that cheating is the most likely explanation.
Question 40: Which test design strategy helps prevent item exposure in high-volume CBT programs?
- Using only one test form
- Maintaining a large item bank with randomized item selection (Correct answer)
- Reducing the number of candidates tested
- Publishing all items after each test window
Correct answer: Maintaining a large item bank with randomized item selection
A large item bank combined with randomized selection reduces the probability that any candidate sees the same items, protecting against memorization and sharing.
Question 41: What is 'disaster recovery' planning in the context of a CBT testing center operation?
- Archiving old exam scores for legal compliance
- Documented procedures to restore exam operations quickly after a power outage, hardware failure, or connectivity loss (Correct answer)
- Installing fire suppression systems in server rooms
- Training staff to assist candidates with disabilities
Correct answer: Documented procedures to restore exam operations quickly after a power outage, hardware failure, or connectivity loss
A disaster recovery plan defines roles, backup systems, and restoration timelines to minimize disruption and protect candidate exam data during incidents.
Question 42: What is a 'sandbox environment' in the context of CBT platform development and quality assurance?
- A practice mode visible only to certified candidates
- A physical room with sandboxed workstations for security testing
- A network segment reserved for candidate biometric data
- An isolated replica of the production system used to test updates and new features without affecting live exams (Correct answer)
Correct answer: An isolated replica of the production system used to test updates and new features without affecting live exams
A sandbox environment mirrors production but is fully isolated, allowing developers and QA teams to validate changes before deploying them to live exam sessions.
Question 43: What does 'chain of custody' refer to in the context of CBT test security?
- The documented process tracking who has access to exam materials at every stage (Correct answer)
- The hierarchy of proctors and supervisors at a testing facility
- The sequence of exam questions presented to a candidate
- The order in which testing centers receive software updates
Correct answer: The documented process tracking who has access to exam materials at every stage
Chain of custody ensures accountability for secure exam materials from creation through delivery, preventing unauthorized access or tampering.
Question 44: Which equating design collects data from a common group of examinees who take both old and new test forms?
- Anchor test (NEAT) design
- Single group design (Correct answer)
- Random groups design
- Calibration design
Correct answer: Single group design
The single group design administers both forms to the same examinees, directly linking the two forms through shared examinee performance.
Question 45: Which reporting practice best supports fairness by ensuring no single demographic group's results are systematically over- or under-reported?
- Reporting only aggregate total scores
- Using only norm-referenced scores
- Suppressing scores below a certain N-count
- Disaggregating score data by subgroups (Correct answer)
Correct answer: Disaggregating score data by subgroups
Disaggregating scores by demographic subgroups allows stakeholders to identify and address performance gaps that may signal bias or inequity.
Question 46: When writing item stems, which practice MOST effectively reduces construct-irrelevant variance?
- Keeping reading level consistent with the target population (Correct answer)
- Phrasing stems as incomplete sentences whenever possible
- Using double negatives to test careful reading
- Including extraneous details to increase item difficulty
Correct answer: Keeping reading level consistent with the target population
Consistent reading level ensures performance reflects the tested construct, not reading ability.
Question 47: Standard Error of Measurement (SEM) is used in CBT score reports to:
- Determine test form difficulty
- Rank examinees against peers
- Calculate the passing rate
- Indicate the precision of an individual's score (Correct answer)
Correct answer: Indicate the precision of an individual's score
SEM quantifies the degree of uncertainty in an individual's observed score, typically displayed as a confidence interval around that score.
Question 48: Which of the following best describes 'content domain weighting' in a test blueprint?
- Selecting only the most recent content
- Ranking questions by difficulty
- Assigning percentage of items to each topic area (Correct answer)
- Ordering topics alphabetically
Correct answer: Assigning percentage of items to each topic area
Content domain weighting specifies what proportion of test items should come from each subject area, ensuring coverage matches job relevance findings.
Question 49: What is the primary role of a 'test delivery system' (TDS) in a CBT platform?
- To write and edit exam questions
- To enroll candidates and process exam fees
- To manage the secure presentation of questions to candidates and capture their responses (Correct answer)
- To compute scaled scores and generate reports
Correct answer: To manage the secure presentation of questions to candidates and capture their responses
The TDS is the runtime engine that authenticates candidates, serves items, tracks responses, enforces time limits, and submits exam data.
Question 50: What sort of wound requires a wound care management plan?
- Complex wound
- Infected wound
- Penetrating wounds
- Any type of wound (Correct answer)
Correct answer: Any type of wound
Every wound, regardless of its type, complexity, or infection status, requires a systematic wound care management plan. This comprehensive plan ensures appropriate assessment, cleaning, dressing, monitoring, and evaluation of the wound's healing progress. A well-structured plan is crucial for optimizing healing, preventing complications, and achieving the best possible patient outcomes.
Question 51: What is the term for designing tests so that accommodations are unnecessary for most candidates because accessibility is built into the standard exam experience?
- Universal Design (Correct answer)
- Differential item functioning
- Assistive technology integration
- Reasonable modification
Correct answer: Universal Design
Universal Design creates exams that are inherently accessible to the broadest range of candidates, reducing the need for individual accommodations.
Question 52: Which emerging technology is being explored to further secure CBT item delivery and prevent content theft?
- Removing all encryption to improve speed
- Printing items on paper before digital delivery
- Posting questions on public websites for candidate review
- Blockchain-based item provenance tracking (Correct answer)
Correct answer: Blockchain-based item provenance tracking
Blockchain provides an immutable, distributed ledger that can log item exposure, detect unauthorized copying, and verify item integrity across exam administrations.
Question 53: A candidate who is deaf requests a sign language interpreter for oral instructions during a CBT exam. This accommodation is BEST described as:
- A reasonable accommodation for a communication barrier unrelated to the tested content (Correct answer)
- Unnecessary because written instructions are displayed on screen
- Only valid if the test measures spoken language skills
- Unreasonable because CBT exams are self-paced
Correct answer: A reasonable accommodation for a communication barrier unrelated to the tested content
Providing an interpreter for oral administrative instructions is a reasonable accommodation that ensures the deaf candidate receives equivalent information.
Question 54: In blueprint terminology, 'anchor items' are used primarily for:
- Score equating across different test forms or administrations (Correct answer)
- Preventing candidates from skipping questions
- Marking the beginning of each content domain
- Increasing item difficulty over time
Correct answer: Score equating across different test forms or administrations
Anchor items appear in multiple test forms and allow psychometricians to place scores from different forms on the same scale through equating.
Question 55: Which term describes the process of identifying the knowledge, skills, and abilities a test should measure?
- Job task analysis (Correct answer)
- Standard setting
- Item banking
- Psychometric scaling
Correct answer: Job task analysis
A job task analysis (JTA) identifies the KSAs required for a role and forms the foundation for test content specifications.
Question 56: A testing organization receives a request for an accommodation that is not on their standard list. The candidate provides comprehensive documentation from a medical professional explaining the need. What is the MOST appropriate first step for the organization?
- Deny the request because it is not a standard accommodation.
- Grant the request immediately without any further review.
- Forward the request to the organization's legal department with a recommendation for denial.
- Engage in an interactive process with the candidate to determine if a reasonable accommodation can be provided. (Correct answer)
Correct answer: Engage in an interactive process with the candidate to determine if a reasonable accommodation can be provided.
Best practices and legal requirements (such as under the ADA) mandate an "interactive process." This involves a good-faith dialogue between the organization and the candidate to discuss the disability, the requested accommodation, and potential alternative accommodations that would be effective without fundamentally altering the nature of the test or causing an undue burden. Simply denying non-standard requests is legally risky and not candidate-focused.
Question 57: On a linear CBT exam (questions presented in fixed order), what is the primary disadvantage compared to a computer-adaptive test?
- Linear exams automatically deduct points for skipped questions
- Linear exams cannot display images or multimedia
- All test-takers see the same questions regardless of performance, reducing measurement precision at extremes (Correct answer)
- Linear exams are always shorter than adaptive exams
Correct answer: All test-takers see the same questions regardless of performance, reducing measurement precision at extremes
Linear exams do not adjust difficulty to the test-taker's ability level, making them less precise at measuring very high or very low performers.
Question 58: What is a 'thin client' workstation as used in some CBT testing centers?
- A low-cost terminal that streams the exam interface from a central server with no local processing or storage (Correct answer)
- A lightweight laptop with no GPU
- A mobile tablet used for portable testing
- A workstation with minimal RAM but a fast SSD
Correct answer: A low-cost terminal that streams the exam interface from a central server with no local processing or storage
Thin clients have no local storage or significant processing power; all exam logic runs on a secure server, reducing the risk of data theft from the endpoint.
Question 59: What is 'on-demand testing' in the context of CBT?
- Testing that occurs only on fixed national exam dates
- Live-streamed exams broadcast to multiple locations simultaneously
- The ability to schedule and sit an exam at a convenient time within a defined window (Correct answer)
- A test format where questions are generated by the candidate
Correct answer: The ability to schedule and sit an exam at a convenient time within a defined window
On-demand CBT allows candidates to choose their own appointment within an authorized testing window rather than being restricted to a single date.
Question 60: A score report includes a 'confidence band' around a candidate's score. What does this band communicate?
- The maximum possible score on the exam
- The range of scores considered passing
- The scores of other candidates who took the same form
- The interval within which the true score likely falls (Correct answer)
Correct answer: The interval within which the true score likely falls
A confidence band (±1 or ±2 SEM) shows the range where the candidate's true score most likely lies, acknowledging inherent measurement uncertainty.
Question 61: Which regulatory or professional body publishes standards that address fairness and validity concerns specific to adaptive testing?
- The American Medical Association (AMA)
- The International Air Transport Association (IATA)
- The Institute of Electrical and Electronics Engineers (IEEE)
- The Standards for Educational and Psychological Testing (AERA/APA/NCME) (Correct answer)
Correct answer: The Standards for Educational and Psychological Testing (AERA/APA/NCME)
The Standards for Educational and Psychological Testing, jointly published by AERA, APA, and NCME, provides authoritative guidance on validity, fairness, and reliability requirements applicable to adaptive tests.
Question 62: An exam development team is reviewing their test blueprint for a financial planning certification. The blueprint specifies that 30% of the questions should assess 'Analysis' skills and 15% should assess 'Evaluation' skills. Linking these cognitive levels to the content domains is a key function of:
- A Job Task Analysis (JTA)
- An Angoff Study
- A Table of Specifications (Correct answer)
- A psychometric audit
Correct answer: A Table of Specifications
A test blueprint is often formatted as a two-dimensional grid called a Table of Specifications (TOS). This table maps content areas against cognitive levels (e.g., from Bloom's Taxonomy, like knowledge, application, analysis), specifying the number or percentage of items for each cell of the grid.
Question 63: An administrator is evaluating two CBT platforms. Platform A stores all candidate data on US-based servers; Platform B stores data on servers in various countries. For a US federal contract, which consideration is most critical?
- Platform A is preferred because US data residency may be required for compliance with FedRAMP or federal data sovereignty rules (Correct answer)
- Data residency has no impact on federal contract eligibility
- Platform B is preferred because distributed storage is more resilient
- Platform B is preferred because international servers have lower latency
Correct answer: Platform A is preferred because US data residency may be required for compliance with FedRAMP or federal data sovereignty rules
US federal contracts often require data to remain within US borders to comply with FedRAMP, FISMA, or other federal data sovereignty requirements.
Question 64: Which of the following technologies is specifically designed to address the threat of a remote test-taker using a deepfake video or a static image to bypass identity verification at the start of an exam?
- IP address geolocation.
- Liveness detection. (Correct answer)
- Data encryption.
- Secure browser lockdown.
Correct answer: Liveness detection.
Liveness detection is a technology that verifies a person is physically present and not a spoof, such as a photo, video, or deepfake. It often requires the candidate to perform actions like blinking or turning their head, which a static image or simple video cannot replicate, ensuring the identity check is being performed on a live individual.
Question 65: What is the PRIMARY purpose of an alternate format accommodation for CBT exam content?
- To reduce test difficulty for the candidate
- To allow the candidate to skip inaccessible questions
- To present the same content in a form accessible to the candidate's disability (Correct answer)
- To shorten the exam duration
Correct answer: To present the same content in a form accessible to the candidate's disability
Alternate formats (braille, large print, audio) present identical content in a form the candidate can access without changing difficulty or construct.
Question 66: A certification body receives a credible tip that a proctor at a third-party test center is colluding with candidates. According to best practices for incident response, what should be the organization's IMMEDIATE first step?
- Assess the situation internally and consult with legal counsel and security experts. (Correct answer)
- Contact the accused proctor directly to demand an explanation.
- Publish a press release about the potential security breach.
- Immediately revoke the credentials of all candidates who tested at that site.
Correct answer: Assess the situation internally and consult with legal counsel and security experts.
The initial step in responding to a security breach is to assess the situation internally to understand the scope and nature of the problem. This involves gathering information, documenting what is known, and consulting with key resources like legal counsel and test security specialists before taking any external action. Acting prematurely without a clear plan can create legal problems and compromise the investigation.
Question 67: What is 'load balancing' and why is it important for large-scale CBT delivery in the US?
- Distributing exam session traffic across multiple servers so no single server becomes a bottleneck (Correct answer)
- Balancing the number of hard and easy questions per exam form
- Allocating exam seats evenly among demographic groups
- Distributing physical exam booklets equally across testing centers
Correct answer: Distributing exam session traffic across multiple servers so no single server becomes a bottleneck
Load balancing ensures consistent response times and uptime when thousands of candidates log in simultaneously across national exam administrations.
Question 68: A testing program reports 'classification consistency.' This statistic measures:
- Whether the test content matches the job analysis
- The correlation between test scores and academic grades
- The likelihood that examinees receive the same pass/fail decision on retesting (Correct answer)
- How closely scores match criterion measures
Correct answer: The likelihood that examinees receive the same pass/fail decision on retesting
Classification consistency estimates the probability that an examinee would receive the same pass or fail decision if they retested under identical conditions.
Question 69: A score report shows a candidate scored at the 78th percentile. This means:
- The candidate needs 22 more points to pass
- The candidate scored higher than 78% of the norm group (Correct answer)
- The candidate answered 78% of questions correctly
- The candidate's score is 78 on a 100-point scale
Correct answer: The candidate scored higher than 78% of the norm group
A percentile rank of 78 means the candidate performed better than 78% of the reference (norm) group.
Question 70: Which tool is most commonly used by testing organizations to detect braindump websites containing leaked exam content?
- Firewall logs from testing centers
- Candidate performance analytics
- Automated web crawlers that search for verbatim exam questions (Correct answer)
- Proctor incident reports
Correct answer: Automated web crawlers that search for verbatim exam questions
Automated crawlers continuously scan the internet for exact matches to exam questions, alerting security teams to potential item compromise.
Question 71: Which of the following best describes a 'fundamental alteration' that would allow a testing organization to deny an accommodation request?
- The test center lacks a private room
- The accommodation would cost more than $500 to provide
- The candidate did not submit documentation before the deadline
- The accommodation would change what the exam is designed to measure (Correct answer)
Correct answer: The accommodation would change what the exam is designed to measure
A fundamental alteration occurs when the accommodation changes the core skills or knowledge the exam is intended to assess, providing legal grounds for denial.
Question 72: Which of the following is the MOST important benefit of using a detailed test blueprint to create multiple forms of a CBT exam?
- It allows for the inclusion of more experimental, unscored items on each form.
- It ensures that all exam forms are parallel in content and difficulty, leading to comparable scores. (Correct answer)
- It reduces the time required for subject matter experts to write new questions.
- It guarantees that every exam form will have the identical average score.
Correct answer: It ensures that all exam forms are parallel in content and difficulty, leading to comparable scores.
A primary function of a test blueprint is to allow for the construction of consistent and parallel exam forms over time. By specifying the number of questions per content area and cognitive level, the blueprint ensures that different versions of the test are equivalent in what they measure and their level of difficulty, which is crucial for fair and equitable assessment.
Question 73: A candidate with dyslexia provides valid medical documentation and requests an accommodation for a computer-based certification exam that is heavily text-based. Which of the following accommodations is MOST likely to directly address the challenges associated with this specific disability?
- Adjustable screen contrast
- A separate testing room
- A text-to-speech screen reader (Correct answer)
- A sign language interpreter
Correct answer: A text-to-speech screen reader
Dyslexia is a learning disability that primarily affects reading. A text-to-speech screen reader directly assists by converting the on-screen text into spoken words, allowing the candidate to listen to the questions and answers, thus bypassing the primary challenge of decoding text. While a separate room might reduce distractions and adjustable contrast might help with visual comfort, neither directly addresses the core issue of reading difficulty. A sign language interpreter is for hearing impairments.
Question 74: What is the role of a 'proctor workstation' that is distinct from an examinee workstation in a CBT center?
- It administers a harder version of the exam
- It stores the encrypted item bank locally
- It grades and scores tests in real time
- It allows the proctor to monitor examinee status, launch tests, and handle incidents (Correct answer)
Correct answer: It allows the proctor to monitor examinee status, launch tests, and handle incidents
The proctor workstation provides administrative control, letting staff monitor test-taking status, authorize starts, and log incidents without accessing item content.
Question 75: It is critical that patients fast effectively before to surgery in order to:
- Reduce the likelihood of vomiting.
- Keep vomiting and chest infections at bay.
- Reduce the possibility of reflux and gastric inhalation. (Correct answer)
- Stop the patient from gagging.
Correct answer: Reduce the possibility of reflux and gastric inhalation.
Fasting before surgery is crucial to minimize the risk of pulmonary aspiration, where stomach contents are regurgitated and inhaled into the lungs during anesthesia. Anesthesia can relax the protective airway reflexes, making patients vulnerable to aspiration if there is food or liquid in the stomach. This complication can lead to severe respiratory issues like aspiration pneumonia.
Question 76: A testing organization needs to provide its board of directors with a high-level overview of exam performance trends from the past year, including pass rates by demographic group and geographic region. To do this, individual candidate score data must be compiled and summarized. This process is known as:
- Data aggregation (Correct answer)
- Standard setting
- Psychometric modeling
- Score scaling
Correct answer: Data aggregation
Data aggregation is the process of collecting and combining data from multiple sources to present it in a summary format. In this scenario, individual candidate results are being grouped and summarized to show trends and patterns for stakeholders, which is a classic use case for data aggregation.
Question 77: Which feature of modern CBT platforms allows exam sponsors to update question pools without rescheduling existing candidates?
- Static item linking
- Manual exam reprinting
- Candidate-controlled question selection
- Dynamic item bank versioning with live pool updates (Correct answer)
Correct answer: Dynamic item bank versioning with live pool updates
Versioned item banks let administrators retire, add, or modify items for new exam draws while existing scheduled appointments continue using the approved pool.
Question 78: Which of the following best describes 'content blueprint' in CBT exam development?
- A list of banned materials candidates cannot bring to the testing center
- A floor plan of the testing center used for proctor positioning
- A document that specifies how many items each topic area must contribute to the exam (Correct answer)
- A graphic design template for the exam user interface
Correct answer: A document that specifies how many items each topic area must contribute to the exam
A content blueprint (also called a test plan or table of specifications) defines the proportion of exam questions that must cover each domain or objective.
Question 79: What distinguishes horizontal equating from vertical scaling in CBT?
- Horizontal equating is used only for adaptive tests
- Vertical scaling requires larger sample sizes than horizontal equating
- Horizontal equating links forms of similar difficulty at the same level; vertical scaling links forms across developmental levels (Correct answer)
- Horizontal equating compares scores across grade levels; vertical scaling does not
Correct answer: Horizontal equating links forms of similar difficulty at the same level; vertical scaling links forms across developmental levels
Horizontal equating connects parallel forms measuring the same construct at the same level, while vertical scaling links forms across different ability or grade levels.
Question 80: In a test blueprint, 'cognitive level' most commonly refers to which taxonomy?
- Webb's Depth of Knowledge
- Marzano's taxonomy
- Gagné's conditions of learning
- Bloom's taxonomy (Correct answer)
Correct answer: Bloom's taxonomy
Bloom's taxonomy (remember, understand, apply, analyze, evaluate, create) is the most widely used framework for categorizing cognitive levels in test blueprints.
Question 81: In a CBT environment, what does 'flagging' a question typically allow you to do?
- Permanently remove the question from the exam
- Alert the proctor about a problematic question
- Skip the question without penalty
- Mark it for review before submitting your final answers (Correct answer)
Correct answer: Mark it for review before submitting your final answers
Flagging marks a question for review so you can revisit it before the exam ends without losing your place.
Question 82: A candidate passes a high-stakes professional licensure exam but later evidence shows the exam was administered with broken security protocols. The licensing board's most legally sound response is to:
- Notify affected candidates and conduct a formal validity review (Correct answer)
- Immediately revoke all licenses issued based on that exam
- Honor all scores since candidates acted in good faith
- Do nothing unless a candidate files a formal complaint
Correct answer: Notify affected candidates and conduct a formal validity review
Regulatory due diligence requires notifying affected parties and conducting a validity study before any adverse action, balancing public protection with candidate rights.
Question 83: Which type of score interpretation compares an examinee's performance to a defined standard rather than to other test-takers?
- Criterion-referenced interpretation (Correct answer)
- Norm-referenced interpretation
- Ipsative interpretation
- Relative interpretation
Correct answer: Criterion-referenced interpretation
Criterion-referenced interpretation judges whether a candidate meets a predetermined performance standard, independent of how others performed.
Question 84: What is 'audit logging' and why is it required in US CBT platforms handling sensitive assessment data?
- Automatically grading essay responses using AI
- Creating tamper-evident records of all system events, user actions, and data access for compliance and forensic review (Correct answer)
- Recording candidate scores publicly for transparency
- Publishing platform uptime reports to exam candidates
Correct answer: Creating tamper-evident records of all system events, user actions, and data access for compliance and forensic review
Audit logs provide an immutable trail of who accessed what data and when, satisfying legal, regulatory, and accreditation requirements for test security and data governance.
Question 85: A proctor observes a candidate whispering during an exam. What is the appropriate first response?
- Contact law enforcement
- Issue a verbal warning and document the incident (Correct answer)
- Move the candidate to a private room
- Immediately void the candidate's exam
Correct answer: Issue a verbal warning and document the incident
Standard protocol calls for a verbal warning and documentation, with escalation only if the behavior continues or other violations are apparent.
Question 86: Confidentiality of a candidate's accommodation records requires that this information be:
- Posted in the testing room so all proctors are aware
- Disclosed to proctors only on a need-to-know basis without revealing the underlying diagnosis (Correct answer)
- Shared with all test center staff to coordinate support
- Stored in the same file as the candidate's test scores
Correct answer: Disclosed to proctors only on a need-to-know basis without revealing the underlying diagnosis
Proctors may know which accommodations to implement but should not receive medical diagnoses; disability information must be handled with strict confidentiality.
Computer-Based Testing (CBT) Knowledge Assessment
A comprehensive knowledge exam covering the principles, technologies, and best practices of computer-based testing, including test design, proctoring, scoring models, accessibility, and candidate experience for testing professionals and administrators.
Exam Rules
- You can skip questions and return to them later
- Flag questions for review before submitting
- No feedback shown until you submit the entire exam
- Unanswered questions count as wrong — answer everything
- 10 pretest questions are mixed in and don't affect your score
- Timer auto-submits when time runs out
- Your progress is auto-saved every 30 seconds