Codebusters Test Assessment Design 3 — Questions and Answers
Question 1: In Codebusters scoring, what is the standard point value awarded for a correctly decoded Aristocrat cipher at the invitational level?
- 150 points plus a time bonus (Correct answer)
- 500 points with no time bonus
- 100 points minus penalty for wrong letters
- 250 points split among team members
Correct answer: 150 points plus a time bonus
At most invitationals, a correctly decoded Aristocrat earns a base score (commonly around 150 points) with additional points awarded based on time remaining.
Question 2: How is partial credit typically handled in a Codebusters assessment when a team decodes most but not all of the plaintext?
- No credit is given unless the entire plaintext is correctly decoded (Correct answer)
- Points are awarded proportionally for each correct letter
- Half credit is given if at least 50% is correct
- The team may submit a second attempt for reduced points
Correct answer: No credit is given unless the entire plaintext is correctly decoded
Standard Codebusters rules require full correct decoding to earn points; partial solutions do not receive partial credit in most official formats.
Question 3: What is the Index of Coincidence (IoC) used for in assessing the difficulty of a cipher?
- To estimate whether a cipher is monoalphabetic or polyalphabetic (Correct answer)
- To measure the total length of the ciphertext
- To determine the exact shift value of a Caesar cipher
- To count the number of unique characters in the ciphertext
Correct answer: To estimate whether a cipher is monoalphabetic or polyalphabetic
The IoC measures the probability that two randomly selected letters from the text are the same, helping distinguish monoalphabetic (high IoC) from polyalphabetic (low IoC) ciphers.
Question 4: When a Codebusters test designer wants to calibrate difficulty, which factor most directly controls how hard an Aristocrat is to solve?
- The length of the ciphertext and frequency of rare letters in the plaintext (Correct answer)
- The color of ink used on the test sheet
- The number of answer blanks provided
- Whether the cipher uses uppercase or lowercase letters
Correct answer: The length of the ciphertext and frequency of rare letters in the plaintext
Longer texts make statistical attacks more reliable (easier), while plaintexts heavy in rare letters reduce the effectiveness of frequency analysis (harder).
Question 5: In a Codebusters invitational, if a team submits an incorrect answer for a toss-up question, what is the typical consequence?
- The team is locked out from answering that toss-up for a penalty period (Correct answer)
- The team loses all accumulated points from that round
- The other team automatically receives the points
- There is no penalty; another attempt is allowed immediately
Correct answer: The team is locked out from answering that toss-up for a penalty period
In Science Olympiad toss-up formats, an incorrect buzz-in typically results in a lockout or penalty, preventing that team from answering the same question again.
Question 6: Which of the following best describes the purpose of including a Baconian cipher in a Codebusters assessment?
- To test steganographic encoding using a two-symbol alphabet (Correct answer)
- To assess knowledge of columnar transposition methods
- To evaluate polyalphabetic key-length determination skills
- To test RSA modular arithmetic computations
Correct answer: To test steganographic encoding using a two-symbol alphabet
The Baconian cipher encodes each letter as a five-character sequence of two symbols (A and B), testing knowledge of early steganographic binary-style encoding systems.
Question 7: Which assessment design principle is violated if all Codebusters questions at a tournament test only Caesar ciphers?
- Content validity, since the assessment fails to represent the full range of cipher knowledge (Correct answer)
- Reliability, since Caesar questions can be answered inconsistently
- Objectivity, since Caesar ciphers have multiple correct answers
- Authenticity, since Caesar ciphers are not real-world relevant
Correct answer: Content validity, since the assessment fails to represent the full range of cipher knowledge
Content validity requires that an assessment covers the full domain of intended knowledge; testing only one cipher type leaves the rest of the curriculum unrepresented.
In Codebusters scoring, what is the standard point value awarded for a correctly decoded Aristocrat cipher at the invitational level?