TS Test Analysis & Reporting 2 — Questions and Answers
Question 1: Which metric measures the percentage of defects found during testing versus total defects found including post-release?
- Defect Density
- Defect Detection Percentage (DDP) (Correct answer)
- Defect Removal Efficiency
- Escaped Defect Rate
Correct answer: Defect Detection Percentage (DDP)
Defect Detection Percentage (DDP) measures the ratio of defects found during testing to the total defects found both during and after testing.
Question 2: A test report shows 80% test cases passed but the product still has critical failures in production. What does this most likely indicate?
- The test environment was misconfigured
- Test coverage was inadequate for critical risk areas (Correct answer)
- The pass rate threshold was set too low
- Defect severity classification was incorrect
Correct answer: Test coverage was inadequate for critical risk areas
A high pass rate with production failures typically indicates that testing did not adequately cover the risk areas where defects later manifested.
Question 3: What is the primary purpose of a traceability matrix in test reporting?
- Track defect resolution timelines
- Show coverage of requirements by test cases (Correct answer)
- Monitor tester productivity metrics
- Log test execution time per module
Correct answer: Show coverage of requirements by test cases
A requirements traceability matrix maps test cases to requirements, demonstrating which requirements have been covered by testing.
Question 4: Which type of test report is most appropriate for communicating testing status to executive stakeholders?
- Detailed defect logs with stack traces
- Test execution spreadsheets with step-by-step results
- High-level summary dashboards with key risk indicators (Correct answer)
- Test case design documents
Correct answer: High-level summary dashboards with key risk indicators
Executive stakeholders need concise, high-level summaries with risk indicators rather than technical testing details.
Question 5: When analyzing test results, what does a 'false positive' mean?
- A test that passes when it should fail
- A defect found that is not actually a defect (Correct answer)
- A requirement that was not tested
- A test case with incorrect expected results
Correct answer: A defect found that is not actually a defect
A false positive occurs when a test reports a failure or defect that does not actually exist in the system under test.
Question 6: Which analysis technique helps identify which code modules have the highest defect concentration?
- Root cause analysis
- Defect clustering analysis (Correct answer)
- Boundary value analysis
- Equivalence partitioning
Correct answer: Defect clustering analysis
Defect clustering analysis identifies modules or components where defects tend to concentrate, helping focus testing and quality efforts.
Question 7: What does 'test burndown' tracking measure in an Agile context?
- Number of testers leaving the team over time
- Remaining test cases versus time elapsed in a sprint (Correct answer)
- Total defects found per sprint velocity
- Test automation coverage trend
Correct answer: Remaining test cases versus time elapsed in a sprint
Test burndown tracks how many test cases remain to be executed against the timeline, helping predict whether testing will complete within the sprint.
TS Test Analysis & Reporting 2
Which metric measures the percentage of defects found during testing versus total defects found including post-release?