CFS Research Methods & Evidence-Based Practice 3 — Questions and Answers
Question 1: Which data collection method is best suited for gathering detailed qualitative insights from experienced floodplain administrators about regulatory challenges?
- Mailed questionnaire with closed-ended items
- Semi-structured in-depth interviews (Correct answer)
- Automated web-scraping of municipal records
- Random digit dialing telephone survey
Correct answer: Semi-structured in-depth interviews
Semi-structured interviews allow experienced practitioners to elaborate on complex regulatory challenges while still guiding the conversation with key topics.
Question 2: When a floodplain researcher reports a p-value of 0.03 for a study on BFE accuracy, what does this indicate?
- There is a 3% probability the null hypothesis is true
- There is a 3% probability of observing the results if the null hypothesis were true (Correct answer)
- The effect size is 3% larger than expected
- The confidence interval is 97% wide
Correct answer: There is a 3% probability of observing the results if the null hypothesis were true
A p-value represents the probability of obtaining results at least as extreme as observed, assuming the null hypothesis is true.
Question 3: A floodplain management agency wants to use GIS-based spatial analysis to identify areas most vulnerable to repetitive flood losses. Which research design element is this?
- Dependent variable operationalization
- Data analysis methodology (Correct answer)
- Theoretical framework selection
- Literature gap identification
Correct answer: Data analysis methodology
Specifying GIS-based spatial analysis as the tool for identifying vulnerable areas defines the data analysis methodology within the research design.
Question 4: In the context of floodplain research, what does 'triangulation' refer to?
- Surveying a floodplain using three measurement benchmarks
- Using multiple data sources or methods to validate findings (Correct answer)
- Calculating flood frequency from three separate gauge stations
- Applying three independent hydraulic models simultaneously
Correct answer: Using multiple data sources or methods to validate findings
Triangulation in research involves using multiple data sources, methods, or investigators to cross-validate findings and increase confidence in results.
Question 5: Which type of error occurs when a floodplain researcher incorrectly concludes that a flood mitigation program was effective when it was not?
- Type II error (false negative)
- Type I error (false positive) (Correct answer)
- Sampling error
- Measurement error
Correct answer: Type I error (false positive)
A Type I error (false positive) occurs when a researcher rejects a true null hypothesis, concluding an effect exists when it does not.
Question 6: Which approach best supports evidence-based decision-making when a CFS professional must recommend flood mitigation options to a local government?
- Relying solely on professional intuition and field experience
- Synthesizing best available research evidence with local context and stakeholder input (Correct answer)
- Applying only FEMA standard procedures without reviewing current literature
- Using only cost-benefit ratios from national databases
Correct answer: Synthesizing best available research evidence with local context and stakeholder input
Evidence-based practice integrates the best available research evidence with professional judgment and local contextual factors to inform decisions.
Question 7: A researcher studying repetitive loss properties uses a Geographic Information System to map flood claim density by census tract. What potential bias must they consider?
- Response bias from property owners
- Ecological fallacy — inferring individual behavior from aggregate area data (Correct answer)
- Interviewer bias in data collection
- Attrition bias from survey dropouts
Correct answer: Ecological fallacy — inferring individual behavior from aggregate area data
Ecological fallacy occurs when conclusions about individuals are incorrectly drawn from data aggregated at the group or area level.
CFS Research Methods & Evidence-Based Practice 3
Which data collection method is best suited for gathering detailed qualitative insights from experienced floodplain administrators about regulatory challenges?