Test Design & Development Flashcards

What is the key difference between 'verification' and 'validation' in test design?

Answer: Verification checks that the product is built correctly against specifications; validation checks that the right product was built for the user's needs

Verification ensures conformance to specifications (are we building it right?), while validation ensures fitness for purpose (are we building the right thing?).

In Mettl's assessment platform, what is the purpose of 'section-level time limits' in test design?

Answer: To control how much time a candidate can spend on a specific section, ensuring balanced assessment of multiple competencies

Section-level time limits in Mettl allow test designers to allocate specific time budgets per competency area, preventing over-investment in one section.

Which test design consideration is MOST critical when creating assessments for remote proctored environments?

Answer: Designing questions that minimize the advantage of external resources while accurately measuring the target competency

Remote assessments require questions that remain valid even if candidates have access to resources, focusing on application and analysis over recall.

What does 'test basis' refer to in test design?

Answer: All the documentation and artifacts from which test cases are derived, such as requirements, designs, and user stories

The test basis is the body of knowledge used to design tests; it includes requirements specifications, design documents, code, and any other reference material.

Which type of coverage criterion requires that every possible combination of condition outcomes within a decision has been tested?

Answer: Multiple Condition Coverage

Multiple Condition Coverage requires testing every possible combination of all conditions in each decision, which can be exponentially large.

When designing regression tests after a bug fix, which selection strategy is considered most efficient?

Answer: Risk-based selection focusing on tests related to changed code and high-impact features

Risk-based regression test selection targets areas most likely affected by the change while prioritizing business-critical functionality, balancing thoroughness and speed.

What is the primary goal of 'test design reviews' conducted before test execution begins?

Answer: To identify gaps, ambiguities, and inconsistencies in test cases before execution, reducing rework and missed defects

Test design reviews catch problems like unclear expected results, missing coverage, or untestable conditions early, when they are cheapest to fix.