MSW Master of Social Work Research and Program Evaluation Questions and Answers — Questions and Answers
Question 1: A school social worker wants to evaluate a new anti-bullying intervention for a single student. The social worker collects baseline data on the student's aggressive behaviors for two weeks (Phase A), implements the intervention for four weeks (Phase B), and then briefly withdraws the intervention to see if aggressive behaviors return (Phase A). Which research design is the social worker using?
- A quasi-experimental design
- An ABA single-subject design (Correct answer)
- A longitudinal cohort study
- A cross-sectional survey
Correct answer: An ABA single-subject design
The ABA single-subject design is characterized by three phases: a baseline period (A), an intervention period (B), and a return to baseline or withdrawal period (A). [2, 5] This design is commonly used in clinical social work to demonstrate the effect of an intervention on a specific target behavior for an individual client. [8, 10]
Question 2: A researcher develops a new instrument to measure burnout in social workers. The instrument is administered to the same group of social workers twice, two weeks apart, and the results are highly consistent. However, a review by experts reveals the questions primarily measure general work stress, not the specific dimensions of burnout (e.g., emotional exhaustion, depersonalization). This instrument has:
- High validity and high reliability
- Low validity and low reliability
- High validity and low reliability
- Low validity and high reliability (Correct answer)
Correct answer: Low validity and high reliability
Reliability refers to the consistency of a measure, which is high in this case because the results were consistent over time. [21, 23] Validity refers to the accuracy of a measure—whether it truly measures the concept it's intended to measure. [23, 26] Since the instrument measures work stress instead of burnout, its validity is low. [26]
Question 3: A community agency is developing a new program to support older adults who are caregivers for their spouses. Before designing the intervention, the agency director wants to understand the scope of caregiving needs, identify existing community resources, and pinpoint service gaps. Which type of program evaluation should be conducted FIRST?
- An outcome evaluation
- A process evaluation
- A needs assessment (Correct answer)
- A cost-benefit analysis
Correct answer: A needs assessment
A needs assessment is the appropriate first step in program development. Its purpose is to systematically gather information to determine the nature and scope of a social problem, which then informs the design of the program. [16, 18] Outcome, process, and cost-benefit evaluations are typically conducted after a program has been implemented. [17]
Question 4: In a study examining the hypothesis that a new job-training program (the intervention) increases the employment rate (the outcome) among formerly incarcerated individuals, the employment rate is the:
- Independent variable
- Control variable
- Confounding variable
- Dependent variable (Correct answer)
Correct answer: Dependent variable
The dependent variable is the outcome that researchers measure to see if it changes in response to the intervention. [3, 7] Its value 'depends' on the changes in the independent variable. [1, 7] The independent variable is the job-training program, which is the cause or intervention being studied. [3]
Question 5: A social worker is conducting a study on the experiences of transgender youth who are experiencing homelessness, a population that is often difficult to access. The social worker initially recruits a few participants from a local LGBTQ+ center and then asks those participants to refer other eligible individuals they know. This sampling method is BEST described as:
- Snowball sampling (Correct answer)
- Simple random sampling
- Stratified sampling
- Convenience sampling
Correct answer: Snowball sampling
Snowball sampling, also known as chain-referral sampling, is a non-probability technique where existing study participants recruit future subjects from among their acquaintances. [12, 24] It is particularly useful for accessing hidden or hard-to-reach populations. [19, 22]
Question 6: An agency director is reviewing a program that has been running for five years. The director wants to determine the program's overall effectiveness and make a final decision about whether it should be continued, expanded, or discontinued. Which type of evaluation is MOST appropriate for this purpose?
- Formative evaluation
- Summative evaluation (Correct answer)
- Process evaluation
- Needs assessment
Correct answer: Summative evaluation
A summative evaluation is conducted at the end of a program to assess its overall effectiveness and impact. [16, 17] It is used to make concluding judgments about a program's merit and inform decisions about its future, such as continuation or termination. [18] Formative and process evaluations occur during a program to make improvements. [16, 18]
