CAST CAST - Test Metrics and Measurement Questions and Answers 2 — Questions and Answers
Question 1: What does a 'defect aging' metric measure?
- The number of defects introduced over time
- How long defects have remained open without being resolved (Correct answer)
- The rate at which new defects are being discovered
- The severity trend of defects across releases
Correct answer: How long defects have remained open without being resolved
Defect aging tracks how long each defect has been in an open state, helping identify bottlenecks in the fix-and-verify cycle.
Question 2: Which type of metric directly reflects end-user perception of software quality?
- Code coverage metrics
- Product metrics such as customer-reported defects (Correct answer)
- Test execution efficiency metrics
- Requirement traceability metrics
Correct answer: Product metrics such as customer-reported defects
Customer-reported defects and user satisfaction scores are product metrics that reflect real-world quality as experienced by users.
Question 3: What is a 'test pass rate' metric?
- The percentage of test cases that were skipped during execution
- The ratio of test cases that passed to total test cases executed (Correct answer)
- The time required to execute a full test suite
- The number of testers who passed their certification exam
Correct answer: The ratio of test cases that passed to total test cases executed
Test pass rate = (Number of tests passed / Total tests executed) × 100%, indicating overall product health.
Question 4: In software testing, what does 'requirements coverage' measure?
- The percentage of source code lines executed during testing
- The proportion of requirements that are traced to at least one test case (Correct answer)
- The number of user stories completed in a sprint
- The ratio of functional to non-functional requirements
Correct answer: The proportion of requirements that are traced to at least one test case
Requirements coverage ensures that every specified requirement has at least one corresponding test case.
Question 5: What is 'mean time to detect' (MTTD) in the context of defect metrics?
- The average time from when a defect is reported to when it is fixed
- The average time from when a defect is introduced to when it is discovered (Correct answer)
- The average time a tester spends on each test case
- The average duration of a full regression test cycle
Correct answer: The average time from when a defect is introduced to when it is discovered
MTTD measures how quickly the testing process identifies defects after they are introduced into the codebase.
Question 6: Why is it important to establish a baseline when using test metrics?
- To ensure all test cases are automated
- To have a reference point for comparing future measurements and tracking improvement (Correct answer)
- To comply with IEEE documentation standards
- To calculate the project budget more accurately
Correct answer: To have a reference point for comparing future measurements and tracking improvement
A baseline provides a benchmark so teams can determine whether metrics are improving, degrading, or staying the same over time.
What does a 'defect aging' metric measure?