CAE Data Analysis & Reporting 3 — Questions and Answers
Question 1: A CAE practitioner uses a Likert scale in a learner satisfaction survey. What type of data do Likert scale responses produce?
- Nominal data
- Ratio data
- Ordinal data (Correct answer)
- Interval data
Correct answer: Ordinal data
Likert scale responses (e.g., strongly agree to strongly disagree) produce ordinal data because responses have a rank order but the intervals between ranks are not necessarily equal.
Question 2: Which approach is most appropriate when an adult educator wants to determine whether a new teaching method caused the observed improvement in learner test scores?
- Descriptive statistics
- Correlation analysis
- Experimental design with a control group (Correct answer)
- Focus group interviews
Correct answer: Experimental design with a control group
Establishing causation requires an experimental or quasi-experimental design with a control group to rule out alternative explanations for the improvement.
Question 3: In program evaluation reporting, the acronym 'KPI' stands for which of the following?
- Key Performance Indicator (Correct answer)
- Knowledge Progress Index
- Kinesthetic Program Integration
- Known Program Impact
Correct answer: Key Performance Indicator
KPIs (Key Performance Indicators) are specific, measurable values used to evaluate how effectively a program is achieving its key objectives.
Question 4: An adult educator receives qualitative feedback from focus groups. Which method would best help convert these responses into analyzable data patterns?
- Calculating the mean response
- Thematic coding (Correct answer)
- Creating a frequency distribution
- Running a t-test
Correct answer: Thematic coding
Thematic coding involves systematically identifying, categorizing, and labeling recurring themes within qualitative data to reveal patterns.
Question 5: When reporting program data to a non-technical audience such as a community board, which strategy is most effective?
- Use detailed statistical tables with p-values
- Present raw data spreadsheets for transparency
- Use visuals and plain language to highlight key findings (Correct answer)
- Include all data collected without summarizing
Correct answer: Use visuals and plain language to highlight key findings
Non-technical audiences are best served by visualizations and plain language that translate complex data into clear, accessible insights tied to program goals.
Question 6: A program finds that its learners' pre-test average was 45% and post-test average was 72%. What is the percentage point gain?
- 27 percentage points (Correct answer)
- 37 percentage points
- 60 percentage points
- 17 percentage points
Correct answer: 27 percentage points
The percentage point gain is calculated by subtracting the pre-test score from the post-test score: 72% − 45% = 27 percentage points.
Question 7: Which term describes the process of comparing an organization's performance data against industry standards or similar organizations?
- Triangulation
- Benchmarking (Correct answer)
- Norming
- Aggregation
Correct answer: Benchmarking
Benchmarking involves comparing program outcomes to established standards or peer organizations to assess relative performance and identify areas for improvement.
CAE Data Analysis & Reporting 3
A CAE practitioner uses a Likert scale in a learner satisfaction survey.
What type of data do Likert scale responses produce?