Social Media Marketing Research & Evidence-Based Practice 4 — Questions and Answers
Question 1: A social media study claims 'brands that post 3x daily earn 50% more sales.' What critical piece of information is missing before applying this finding?
- The names of the brands studied
- Whether the relationship is causal or merely correlational (Correct answer)
- The total duration of the study
- The geographic location of the researchers
Correct answer: Whether the relationship is causal or merely correlational
Correlation between posting frequency and sales does not establish that increased posting caused the sales lift; confounders like brand size or budget could explain both.
Question 2: Which qualitative research method is best suited to uncover deep motivations behind why consumers share branded content?
- Platform analytics dashboards
- In-depth interviews with a small group of active sharers (Correct answer)
- Click-through rate analysis across campaigns
- Follower demographic reports
Correct answer: In-depth interviews with a small group of active sharers
In-depth interviews surface nuanced motivations, emotions, and social dynamics that quantitative metrics cannot reveal.
Question 3: A DTC brand wants to measure the true incrementality of its Instagram ad spend. Which research design is most appropriate?
- Comparing monthly revenue before and after the campaign
- Running a geo-based holdout test with a matched control market receiving no ads (Correct answer)
- Analyzing CTR and ROAS within the ad platform's dashboard
- Surveying customers who clicked the ad about their purchase intent
Correct answer: Running a geo-based holdout test with a matched control market receiving no ads
A geo-based holdout test creates a true control group, allowing measurement of lift attributable solely to the ad spend versus organic demand.
Question 4: What does a high 'saves' rate on Instagram posts indicate from a research perspective?
- Users found the content entertaining but not useful
- Content has strong utility value and users intend to reference it later (Correct answer)
- The post received significant paid promotion
- Followers are disengaged with the account overall
Correct answer: Content has strong utility value and users intend to reference it later
Saves signal that content is perceived as valuable enough to revisit, indicating high informational or inspirational utility for the audience.
Question 5: Which statistical concept explains why a social media test with only 50 conversions per variant may produce unreliable results?
- Confirmation bias
- Low statistical power leading to underpowered tests (Correct answer)
- Regression to the mean
- Selection bias from targeted audiences
Correct answer: Low statistical power leading to underpowered tests
Low sample sizes reduce statistical power, increasing the risk of false positives (Type I error) and false negatives (Type II error) in test results.
Question 6: A brand uses Net Promoter Score (NPS) surveys distributed via social media DM. What research bias is most likely introduced?
- Social desirability bias from in-person interviews
- Self-selection bias from respondents who are already highly engaged with the brand (Correct answer)
- Acquiescence bias from leading questions
- Recency bias from surveying only recent followers
Correct answer: Self-selection bias from respondents who are already highly engaged with the brand
Users who respond to DM surveys are disproportionately brand advocates, skewing NPS results higher than the true customer population average.
Question 7: A social media manager wants to benchmark their engagement rate. What is the most methodologically sound approach?
- Compare to the platform's overall average across all account sizes
- Compare to industry peers in the same niche with similar follower count ranges (Correct answer)
- Use the highest-performing competitor as the single benchmark
- Set a benchmark based on the account's all-time best performing post
Correct answer: Compare to industry peers in the same niche with similar follower count ranges
Benchmarking against industry peers with similar follower counts controls for the well-documented inverse relationship between follower count and engagement rate.
Social Media Marketing Research & Evidence-Based Practice 4
A social media study claims 'brands that post 3x daily earn 50% more sales.' What critical piece of information is missing before applying this finding?