CTC Data Analysis & Reporting 3 — Questions and Answers
Question 1: A root cause analysis on escaped defects reveals 60% originated during requirements phase. Which action best addresses this finding?
- Strengthen requirements review and static testing early in the lifecycle (Correct answer)
- Add more regression test cycles before each release
- Increase the number of testers assigned to system testing
- Automate all functional test cases
Correct answer: Strengthen requirements review and static testing early in the lifecycle
Since the defects originate in requirements, the highest leverage is shifting quality activities left to catch issues at that phase.
Question 2: In IEEE 829-style test reporting, which document provides the formal record of test execution results for individual test cases?
- Test log (Correct answer)
- Test incident report
- Test summary report
- Test plan
Correct answer: Test log
The test log (or test execution log) chronologically records each test case run, its outcome, and any anomalies observed during execution.
Question 3: A data analyst computes the correlation coefficient between test execution hours and defects found as r = 0.08. What does this indicate?
- Virtually no linear relationship between hours spent and defects found (Correct answer)
- A strong positive relationship between effort and defect discovery
- A negative relationship that requires further investigation
- The data set is too small to draw any conclusion
Correct answer: Virtually no linear relationship between hours spent and defects found
An r value near zero indicates negligible linear correlation, meaning effort hours alone do not predict defect discovery in this dataset.
Question 4: Which visualization is most effective for comparing defect counts across five different product modules simultaneously?
- Clustered bar chart (Correct answer)
- Line graph
- Pie chart
- Scatter plot
Correct answer: Clustered bar chart
A clustered bar chart allows direct side-by-side magnitude comparison across multiple discrete categories such as modules.
Question 5: A test conductor must report test progress to both technical leads and executive sponsors. What is the best practice?
- Create two reports: a detailed technical report and a high-level executive dashboard (Correct answer)
- Send the same detailed technical report to both audiences
- Provide only the executive dashboard to avoid information overload for developers
- Verbally summarize findings to executives and send written reports only to developers
Correct answer: Create two reports: a detailed technical report and a high-level executive dashboard
Tailoring reporting depth and terminology to each audience ensures the information is actionable and appropriate for their decision-making needs.
Question 6: Which formula correctly expresses test execution progress as a percentage when some test cases are blocked?
- (Passed + Failed) / (Total Planned) × 100 (Correct answer)
- (Passed) / (Total Planned) × 100
- (Passed + Failed + Blocked) / (Total Planned) × 100
- (Total Planned − Blocked) / (Total Planned) × 100
Correct answer: (Passed + Failed) / (Total Planned) × 100
Execution progress counts all actively run cases (passed + failed); blocked cases have not been executed and should not inflate the numerator.
Question 7: When analyzing test data, a bimodal distribution in test execution times suggests what condition?
- Two distinct subpopulations exist within the test suite, such as fast unit tests and slow integration tests (Correct answer)
- The test environment is unreliable and producing random results
- The mean execution time is a reliable central tendency measure
- All tests are performing within acceptable performance thresholds
Correct answer: Two distinct subpopulations exist within the test suite, such as fast unit tests and slow integration tests
A bimodal distribution has two peaks, indicating two different groups of tests with different execution characteristics are mixed in the dataset.
CTC Data Analysis & Reporting 3
A root cause analysis on escaped defects reveals 60% originated during requirements phase.
Which action best addresses this finding?