Free Lean Six Sigma Black Belt Analyze Phase: Hypothesis Testing Questions and Answers — Questions and Answers
Question 1: A Black Belt is analyzing process data to determine if there is a statistically significant difference between the average cycle times of three different production lines. The data is continuous and assumed to be normally distributed. Which of the following hypothesis tests is most appropriate for this scenario?
- 2-Sample t-test
- Chi-Square Test
- Analysis of Variance (ANOVA) (Correct answer)
- Paired t-test
Correct answer: Analysis of Variance (ANOVA)
Analysis of Variance (ANOVA) is the correct statistical test to use when comparing the means of three or more independent groups. A 2-Sample t-test is only used for comparing the means of two groups. A Chi-Square test is used for analyzing categorical or discrete data, not continuous data like cycle times. A Paired t-test is used when the data points are linked or have a natural pairing between the two groups being compared, which is not the case here with three independent production lines.
Question 2: In the context of hypothesis testing, what is the null hypothesis (H₀)?
- The hypothesis that the researcher is trying to prove.
- A statement that there is no effect or no difference between the groups being studied. (Correct answer)
- The probability of observing the data if the alternative hypothesis is true.
- The conclusion that a statistically significant relationship exists.
Correct answer: A statement that there is no effect or no difference between the groups being studied.
The null hypothesis (H₀) represents the 'status quo' or the default assumption that there is no significant difference, no relationship, or no effect between the variables being tested. The goal of hypothesis testing is to collect enough statistical evidence to reject this null hypothesis in favor of the alternative hypothesis.
Question 3: A project team conducted a hypothesis test to evaluate a process improvement. They calculated a p-value of 0.03. If their chosen significance level (alpha) is 0.05, what is the correct conclusion?
- Fail to reject the null hypothesis, as the p-value is greater than alpha.
- Accept the alternative hypothesis because the p-value is small.
- Reject the null hypothesis, as the p-value is less than the significance level. (Correct answer)
- Conclude the test is invalid because the p-value is not zero.
Correct answer: Reject the null hypothesis, as the p-value is less than the significance level.
The standard rule for hypothesis testing is to compare the p-value to the pre-determined significance level (alpha). If the p-value is less than or equal to alpha, the null hypothesis is rejected. In this case, 0.03 is less than 0.05, so the team should reject the null hypothesis and conclude that there is a statistically significant effect.
Question 4: A Six Sigma team is concerned about making a Type I error in their hypothesis test. What does a Type I error represent?
- Concluding there is no effect when one actually exists.
- Failing to reject a false null hypothesis.
- Incorrectly rejecting a true null hypothesis. (Correct answer)
- Accepting the null hypothesis when it is false.
Correct answer: Incorrectly rejecting a true null hypothesis.
A Type I error, also known as a 'false positive,' occurs when the null hypothesis is rejected even though it is actually true. The probability of making a Type I error is determined by the significance level, alpha (α).
Question 5: A Black Belt wants to determine if there is a relationship between two categorical variables: 'Shift' (1st, 2nd, 3rd) and 'Defect Type' (Cosmetic, Functional, Documentation). Which statistical test should be used to analyze this data?
- ANOVA
- 1-Proportion Test
- Chi-Square Test of Independence (Correct answer)
- 2-Sample t-test
Correct answer: Chi-Square Test of Independence
The Chi-Square Test of Independence is used to determine if there is a significant association between two categorical variables. Since both 'Shift' and 'Defect Type' are categorical, this is the appropriate test. ANOVA and t-tests are used for continuous data, while a 1-Proportion test is for a single categorical variable.
Question 6: A project team implements a change to reduce machine setup time. They conduct a hypothesis test and fail to reject the null hypothesis. However, in reality, the change did significantly reduce the setup time. What type of error has occurred?
- Alpha Risk
- Type I Error
- Type II Error (Correct answer)
- Sampling Error
Correct answer: Type II Error
A Type II error, also known as a 'false negative' or Beta (β) risk, occurs when one fails to reject a null hypothesis that is actually false. In this scenario, the team missed a real improvement because the statistical test did not detect the significant difference.
A Black Belt is analyzing process data to determine if there is a statistically significant difference between the average cycle times of three different production lines.
The data is continuous and assumed to be normally distributed.
Which of the following hypothesis tests is most appropriate for this scenario?