Mettl Test Design & Development 5 — Questions and Answers
Question 1: What is the key difference between 'verification' and 'validation' in test design?
- Verification tests the final product; validation tests individual components
- Verification checks that the product is built correctly against specifications; validation checks that the right product was built for the user's needs (Correct answer)
- Verification is done by developers; validation is done by clients only
- There is no difference in modern agile testing
Correct answer: Verification checks that the product is built correctly against specifications; validation checks that the right product was built for the user's needs
Verification ensures conformance to specifications (are we building it right?), while validation ensures fitness for purpose (are we building the right thing?).
Question 2: In Mettl's assessment platform, what is the purpose of 'section-level time limits' in test design?
- To prevent candidates from skipping questions
- To control how much time a candidate can spend on a specific section, ensuring balanced assessment of multiple competencies (Correct answer)
- To automatically submit incomplete answers
- To randomize question order within a section
Correct answer: To control how much time a candidate can spend on a specific section, ensuring balanced assessment of multiple competencies
Section-level time limits in Mettl allow test designers to allocate specific time budgets per competency area, preventing over-investment in one section.
Question 3: Which test design consideration is MOST critical when creating assessments for remote proctored environments?
- Using only essay-type questions to reduce cheating
- Designing questions that minimize the advantage of external resources while accurately measuring the target competency (Correct answer)
- Removing all time limits to reduce candidate stress
- Using only questions from publicly available question banks
Correct answer: Designing questions that minimize the advantage of external resources while accurately measuring the target competency
Remote assessments require questions that remain valid even if candidates have access to resources, focusing on application and analysis over recall.
Question 4: What does 'test basis' refer to in test design?
- The baseline version of the software before any modifications
- All the documentation and artifacts from which test cases are derived, such as requirements, designs, and user stories (Correct answer)
- The minimum number of tests required for release approval
- The test execution environment configuration
Correct answer: All the documentation and artifacts from which test cases are derived, such as requirements, designs, and user stories
The test basis is the body of knowledge used to design tests; it includes requirements specifications, design documents, code, and any other reference material.
Question 5: Which type of coverage criterion requires that every possible combination of condition outcomes within a decision has been tested?
- Statement Coverage
- Branch Coverage
- Modified Condition/Decision Coverage (MC/DC)
- Multiple Condition Coverage (Correct answer)
Correct answer: Multiple Condition Coverage
Multiple Condition Coverage requires testing every possible combination of all conditions in each decision, which can be exponentially large.
Question 6: When designing regression tests after a bug fix, which selection strategy is considered most efficient?
- Re-running all existing test cases regardless of the change
- Risk-based selection focusing on tests related to changed code and high-impact features (Correct answer)
- Running only the single test case that originally caught the bug
- Randomly selecting 50% of the existing test suite
Correct answer: Risk-based selection focusing on tests related to changed code and high-impact features
Risk-based regression test selection targets areas most likely affected by the change while prioritizing business-critical functionality, balancing thoroughness and speed.
Question 7: What is the primary goal of 'test design reviews' conducted before test execution begins?
- To count the total number of test cases created
- To identify gaps, ambiguities, and inconsistencies in test cases before execution, reducing rework and missed defects (Correct answer)
- To assign test cases to automation tools
- To estimate the time needed for test execution
Correct answer: To identify gaps, ambiguities, and inconsistencies in test cases before execution, reducing rework and missed defects
Test design reviews catch problems like unclear expected results, missing coverage, or untestable conditions early, when they are cheapest to fix.
Mettl Test Design & Development 5
What is the key difference between 'verification' and 'validation' in test design?