CBT - Computer Based Testing Item Authoring and Banking Questions and Answers — Questions and Answers
Question 1: A certification body is developing a new computer-based test. To ensure the defensibility and integrity of the exam, which of the following is the MOST critical feature of their item banking system?
- A user-friendly interface for item authors.
- The ability to categorize items by content area and difficulty level.
- A comprehensive version history with tracking of all changes made to an item. (Correct answer)
- Integration with social media for candidate feedback.
Correct answer: A comprehensive version history with tracking of all changes made to an item.
While a user-friendly interface and item categorization are important, a comprehensive version history is the most critical feature for defensibility. In case of a legal challenge or an accreditation review, the organization must be able to demonstrate a documented review process, controlled changes, and a clear audit trail for every item.
Question 2: When authoring multiple-choice questions for a professional certification exam, what is the primary purpose of a well-written distractor?
- To trick candidates who have only partially studied the material.
- To be plausible to uninformed candidates but incorrect to knowledgeable ones. (Correct answer)
- To introduce ambiguity and increase the cognitive load of the item.
- To provide a humorous or obviously wrong option to reduce test anxiety.
Correct answer: To be plausible to uninformed candidates but incorrect to knowledgeable ones.
The goal of a distractor is to differentiate between candidates who have the required knowledge and those who do not. A plausible but incorrect option will appeal to test-takers who are guessing or lack complete understanding, while a knowledgeable candidate will be able to identify it as incorrect.
Question 3: A test development team is migrating thousands of existing test items from a spreadsheet into a new, sophisticated item banking system. To maximize the system's utility for future test assembly, what is the most crucial task to perform during this migration?
- Ensuring all graphics are converted to a high-resolution format.
- Running a spell check on every item stem and option.
- Assigning detailed and structured metadata to each item. (Correct answer)
- Standardizing the font and point size for all items.
Correct answer: Assigning detailed and structured metadata to each item.
Assigning structured metadata (e.g., content area, cognitive level, author, psychometric data) is the most critical task. This metadata allows for efficient searching, filtering, and automated test assembly based on the exam blueprint, which is a core function of an item banking system.
Question 4: An item writer is tasked with creating a scenario-based question to assess a candidate's application of knowledge, rather than simple recall. Which of the following stems represents the BEST approach?
- "Which of the following is a key provision of the ABC Act of 2023?"
- "A client presents with symptoms of X and Y. Based on the professional code of conduct, what is the MOST appropriate initial action?" (Correct answer)
- "Define the term 'procedural compliance' as it relates to industry standards."
- "List the four primary steps involved in the standard risk assessment process."
Correct answer: "A client presents with symptoms of X and Y. Based on the professional code of conduct, what is the MOST appropriate initial action?"
Scenario-based questions present a realistic situation and require the candidate to apply their knowledge to make a decision or solve a problem. The stem describing a client situation directly assesses the application of professional standards, which is a higher-order cognitive skill than recall or definition.
Question 5: What is the primary security benefit of having a large and robust item bank for a high-stakes computer-based testing program?
- It reduces the need for human proctors during the exam.
- It allows for the creation of more difficult test forms.
- It minimizes item exposure, reducing the risk of questions being shared. (Correct answer)
- It simplifies the process of translating exams into multiple languages.
Correct answer: It minimizes item exposure, reducing the risk of questions being shared.
A large item bank allows for the creation of many unique test forms. This limits the number of times any single item is exposed to candidates, making it more difficult for test content to be memorized and shared, thereby enhancing the overall security of the exam.
Question 6: Which of the following describes the ideal item lifecycle management process within an item bank?
- Items are written, used once, and then immediately retired to prevent exposure.
- Items are permanently kept in an 'active' status after their initial approval.
- Items move through defined stages such as Draft, Review, Active, Flagged, and Retired. (Correct answer)
- Items are reviewed only when a candidate formally challenges their validity.
Correct answer: Items move through defined stages such as Draft, Review, Active, Flagged, and Retired.
Effective governance of an item bank requires a clear item lifecycle. Items should progress through distinct, defined stages from creation (Draft) to approval (Active) and eventual removal (Retired). This ensures that items are properly reviewed, monitored for performance (Flagged), and taken out of circulation when outdated or overexposed.
CBT - Computer Based Testing Item Authoring and Banking Questions and Answers
A certification body is developing a new computer-based test.
To ensure the defensibility and integrity of the exam, which of the following is the MOST critical feature of their item banking system?