CAE Data Analysis & Reporting 2 — Questions and Answers
Question 1: An adult educator notices that post-test scores improved significantly but attendance dropped during the same period. This situation best illustrates which data analysis challenge?
- Sampling bias
- Confounding variables (Correct answer)
- Regression to the mean
- Selection effect
Correct answer: Confounding variables
Confounding variables occur when an outside factor (attendance) may influence the outcome being measured (test scores), making it difficult to attribute changes solely to instruction.
Question 2: Which measure of central tendency is most appropriate when reporting income levels for adult learners, given that a few extremely high earners are in the sample?
- Mean
- Median (Correct answer)
- Mode
- Range
Correct answer: Median
The median is preferred over the mean when extreme outliers (very high or low values) would skew the average and misrepresent the typical learner's income.
Question 3: A program director wants to compare GED completion rates across five different learning centers. Which type of chart is most effective for this comparison?
- Pie chart
- Line graph
- Bar chart (Correct answer)
- Scatter plot
Correct answer: Bar chart
Bar charts are ideal for comparing discrete categories (learning centers) across a single metric (completion rate) side by side.
Question 4: In a needs assessment report, a CAE practitioner writes that '68% of learners reported difficulty with digital literacy.' This figure is an example of which type of data?
- Qualitative data
- Anecdotal data
- Quantitative data (Correct answer)
- Normative data
Correct answer: Quantitative data
A percentage derived from learner self-reports is quantitative data because it represents a numerical measurement of a characteristic.
Question 5: Which statistical concept refers to the degree to which a test consistently produces the same results under the same conditions?
- Validity
- Reliability (Correct answer)
- Norming
- Fidelity
Correct answer: Reliability
Reliability measures the consistency of a test or instrument across repeated administrations, while validity measures whether it tests what it intends to measure.
Question 6: An adult education program collects learner satisfaction surveys after each course. To identify trends across multiple cohorts, the educator should use which approach?
- Cross-sectional analysis
- Longitudinal analysis (Correct answer)
- Case study analysis
- Cohort sampling
Correct answer: Longitudinal analysis
Longitudinal analysis tracks the same type of data across multiple time points or cohorts to identify patterns and trends over time.
Question 7: When an adult educator's program report shows a 15% improvement in learner outcomes, stakeholders should also ask for which additional piece of information to properly interpret this result?
- The educator's credentials
- The baseline starting point (Correct answer)
- The name of the curriculum used
- The number of classrooms available
Correct answer: The baseline starting point
A percentage improvement is only meaningful when compared against a baseline; without knowing where learners started, the magnitude of improvement cannot be properly assessed.
CAE Data Analysis & Reporting 2
An adult educator notices that post-test scores improved significantly but attendance dropped during the same period.
This situation best illustrates which data analysis challenge?