Assessment & Evaluation Techniques Flashcards
7 cards from real CRP practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Assessment & Evaluation Techniques flashcards as text
Which evaluation framework emphasizes the intended use by intended users as the primary criterion for evaluation design?
Answer: Utilization-focused evaluation
Utilization-focused evaluation, developed by Michael Quinn Patton, designs every evaluation decision around ensuring that findings will actually be used by specific stakeholders.
A researcher uses a Likert scale ranging from 'Strongly Disagree' to 'Strongly Agree.' This scale produces data at which level of measurement?
Answer: Ordinal
Likert scales produce ordinal data because categories are ranked but the intervals between them cannot be assumed to be equal.
When a research team conducts a 'triangulation' strategy, they are attempting to:
Answer: Increase validity by cross-verifying findings from multiple data sources or methods
Triangulation strengthens the validity of findings by comparing and converging evidence from different data sources, methods, or investigators.
Which approach is best suited for evaluating a newly emerging, innovative program whose goals and activities are still evolving?
Answer: Developmental evaluation
Developmental evaluation, associated with Patton, supports real-time learning and adaptation for programs still being developed in complex, dynamic environments.
Sensitivity and specificity are evaluation metrics most commonly associated with which type of assessment instrument?
Answer: Diagnostic screening tests
Sensitivity (true positive rate) and specificity (true negative rate) are standard metrics for evaluating the performance of diagnostic or screening tests.
In a research report, 'effect size' is reported in addition to p-values because it:
Answer: Indicates the practical or substantive magnitude of the observed difference
Effect size quantifies how large or meaningful a difference is, which statistical significance alone (p-value) cannot convey.
What is the main limitation of using pre-existing administrative data for program evaluation?
Answer: The data may not align with the specific outcomes or measures relevant to the evaluation
Administrative data were collected for operational purposes, so they may lack measures directly relevant to the evaluation's questions or outcomes of interest.