TS Statistical Analysis & Reporting 3 — Questions and Answers
Question 1: Which correlation coefficient value indicates the STRONGEST linear relationship between two test metrics?
- 0.45
- -0.87 (Correct answer)
- 0.12
- -0.23
Correct answer: -0.87
The strength of correlation is determined by the absolute value; -0.87 has the highest absolute value (0.87) among the options.
Question 2: A test specialist is comparing defect rates across three different development teams. Which statistical test is MOST appropriate?
- t-test
- Chi-square test
- ANOVA (Correct answer)
- Mann-Whitney U test
Correct answer: ANOVA
ANOVA (Analysis of Variance) is used to compare means across three or more groups simultaneously.
Question 3: In test metrics reporting, 'test effectiveness' is BEST defined as:
- Number of tests executed per hour
- Percentage of defects found by testing versus total defects (Correct answer)
- Total test execution time divided by number of testers
- Number of automated tests divided by total tests
Correct answer: Percentage of defects found by testing versus total defects
Test effectiveness measures how well testing identifies defects compared to the total number of defects that exist.
Question 4: When creating a test progress report, which metric BEST indicates whether testing will complete on schedule?
- Number of defects found to date
- Test case execution rate compared to planned rate (Correct answer)
- Total lines of code covered
- Defect severity distribution
Correct answer: Test case execution rate compared to planned rate
Comparing actual test execution rate to the planned rate directly indicates whether the project is on track to complete testing on time.
Question 5: A p-value of 0.03 in a statistical hypothesis test means:
- There is a 3% chance the hypothesis is true
- There is a 97% chance the results are correct
- There is a 3% probability of observing these results if the null hypothesis is true (Correct answer)
- The test has 97% statistical power
Correct answer: There is a 3% probability of observing these results if the null hypothesis is true
The p-value represents the probability of obtaining results at least as extreme as observed, assuming the null hypothesis is true.
Question 6: Which type of data visualization is MOST effective for identifying trends in daily defect discovery over a 3-month period?
- Bar chart
- Line chart (Correct answer)
- Box plot
- Radar chart
Correct answer: Line chart
Line charts are ideal for displaying trends and changes in data over continuous time periods.
Question 7: In a defect age report, 'defect age' refers to:
- The severity level of the defect
- The time elapsed from defect detection to resolution (Correct answer)
- The number of times a defect has been reopened
- The version of software where the defect was introduced
Correct answer: The time elapsed from defect detection to resolution
Defect age measures the lifecycle duration of a defect from when it was discovered until it was closed or fixed.
TS Statistical Analysis & Reporting 3
Which correlation coefficient value indicates the STRONGEST linear relationship between two test metrics?