Data Analysis & Reporting Flashcards

A test conductor receives a defect aging report showing 35 high-priority defects open for more than 14 days. What is the most appropriate escalation trigger to use?

Answer: Severity-weighted age threshold defined in the test plan

Escalation thresholds defined in the test plan provide an objective, pre-agreed standard for when to raise concerns, removing subjectivity.

Which measure of central tendency is most resistant to outlier test execution times skewing the data summary?

Answer: Median

The median splits the dataset at the midpoint and is unaffected by extreme values, making it more robust than the mean when outliers exist.

A Pareto analysis of defect categories shows that three categories account for 76% of all defects. How should a test conductor use this finding?

Answer: Prioritize test coverage and review efforts on those three categories first

The Pareto principle guides focusing limited resources on the vital few categories that produce the majority of defects for maximum impact.

In test reporting, what is the primary purpose of a test incident report (also called a defect report)?

Answer: To document any event during testing that requires investigation or follow-up

A test incident report captures unexpected events—not just defects—that occurred during execution and need investigation to determine their cause.

A project uses risk-based testing. How should the test summary report reflect this approach?

Answer: Report coverage and residual risk by risk level, showing which high-risk areas were fully tested

Risk-based testing reports must map results back to the risk register so stakeholders can evaluate residual risk in each risk category.

Which data normalization technique is used to compare defect counts fairly between a module with 500 lines of code and one with 50,000 lines?

Answer: Calculate defect density (defects per KLOC) for each module

Normalizing by size (defects per thousand lines of code) removes the size bias, enabling a fair quality comparison between differently sized modules.

A confidence interval for mean defect fix time is reported as [3.2 days, 6.8 days] at 95% confidence. What does this mean for a test conductor?

Answer: There is 95% probability the true mean fix time falls between 3.2 and 6.8 days

A 95% confidence interval means if the sampling process were repeated many times, 95% of such intervals would contain the true population mean.