← All CAE Flashcard Decks

Evaluation Strategies Flashcards

7 cards from real CAE practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.

Read the first 7 Evaluation Strategies flashcards as text
  1. A CAE practitioner wants to evaluate whether a financial literacy course changed participants' actual savings behavior six months later. The MOST rigorous design would include:

    Answer: A randomized control group followed up at six months

    A randomized control group with a six-month follow-up allows causal attribution of behavior change to the program rather than to external factors.

  2. Which principle of ethical evaluation practice requires that evaluation findings be shared with all relevant stakeholders in accessible language?

    Answer: Integrity and honesty

    The integrity and honesty principle includes transparent reporting of findings to stakeholders in a way they can understand and use.

  3. An adult educator reports a statistically significant improvement on a post-test but notes the effect size is d = 0.08. What should the educator conclude?

    Answer: The improvement is statistically significant but practically negligible

    An effect size of d = 0.08 is very small; statistical significance with large samples can detect trivial differences that have little practical importance.

  4. Which evaluation model explicitly considers the context, inputs, processes, and products of a program?

    Answer: CIPP Model

    The CIPP Model (Context, Input, Process, Product) developed by Stufflebeam evaluates all four dimensions to support comprehensive program decision-making.

  5. A learner's prior work experience leads them to score high on a pre-assessment without any instruction. In evaluation, this phenomenon threatens which type of validity?

    Answer: Internal validity through selection bias

    Selection bias occurs when pre-existing characteristics of participants—such as extensive prior experience—influence outcomes independent of the program.

  6. An evaluation report recommends discontinuing a popular program because data show it does not achieve its stated outcomes. Stakeholders resist the findings. The BEST evaluator response is to:

    Answer: Present the evidence transparently and engage stakeholders in interpreting implications

    Ethical evaluation practice requires honest reporting; evaluators should facilitate stakeholder understanding of evidence rather than alter findings to reduce resistance.

  7. A learning management system automatically collects time-on-task and module completion rates. This type of data is BEST described as:

    Answer: Unobtrusive or trace data

    Trace or unobtrusive data are automatically generated records of behavior that do not require learner self-report, reducing social desirability concerns.