Social Media Marketing Research & Evidence-Based Practice 3 — Questions and Answers
Question 1: A social media manager notices engagement drops every Tuesday. Before changing the posting schedule, what research step should they take first?
- Immediately switch all Tuesday posts to a different day
- Segment the data by content type to determine if format, not timing, drives the drop (Correct answer)
- Ask followers via a poll what day they prefer content
- Reduce Tuesday posting frequency by 50%
Correct answer: Segment the data by content type to determine if format, not timing, drives the drop
Segmenting by content type isolates whether the timing or a confounding content variable is responsible for the observed pattern.
Question 2: Which sampling method would produce the most representative insights for a US-focused social media survey about Gen Z brand perception?
- Surveying followers of your brand's Instagram account only
- Random sampling from a panel representative of US Gen Z demographics (Correct answer)
- Collecting responses from users who comment on your posts
- Polling users who have made a purchase in the last 6 months
Correct answer: Random sampling from a panel representative of US Gen Z demographics
A demographically representative random sample avoids self-selection bias present in follower-only or purchase-history-based samples.
Question 3: A brand reports a 200% increase in social media-driven conversions after launching a new campaign. Without a control group, what research limitation applies?
- The sample size is too small to be meaningful
- It is impossible to isolate the campaign's effect from other concurrent factors (Correct answer)
- The conversion metric is not a valid KPI for social media
- The 200% increase proves the campaign was the sole driver
Correct answer: It is impossible to isolate the campaign's effect from other concurrent factors
Without a control group, external factors like seasonality, promotions, or PR coverage cannot be ruled out as contributors to the lift.
Question 4: What is the primary purpose of a social media listening study conducted before a product launch?
- To build follower count before launch day
- To identify existing audience sentiments, language, and pain points that can inform messaging (Correct answer)
- To determine the optimal ad spend budget
- To measure competitor follower growth rates
Correct answer: To identify existing audience sentiments, language, and pain points that can inform messaging
Pre-launch listening reveals authentic audience language, unmet needs, and emotional triggers that make campaign messaging more resonant.
Question 5: A marketer is analyzing platform analytics and sees reach increased 40% while engagement rate dropped 15%. What is the most likely evidence-based explanation?
- The content quality improved significantly
- The content reached a larger but less targeted audience (Correct answer)
- The platform's algorithm began suppressing the account
- Follower churn caused the engagement decline
Correct answer: The content reached a larger but less targeted audience
When reach expands (via paid promotion or virality) beyond the core audience, new viewers engage at lower rates, diluting the engagement percentage.
Question 6: Which of the following best describes 'vanity metrics' in social media research?
- Metrics that require expensive third-party tools to measure
- Numbers that look impressive but have weak correlation with business outcomes (Correct answer)
- Metrics that are only visible to account administrators
- KPIs used exclusively for influencer partnership evaluation
Correct answer: Numbers that look impressive but have weak correlation with business outcomes
Vanity metrics like raw follower counts or total impressions look favorable but rarely translate directly into revenue or meaningful business impact.
Question 7: When designing a social media experiment, why is it important to test only one variable at a time?
- Testing multiple variables simultaneously is too expensive
- It allows you to attribute observed differences to a specific change with confidence (Correct answer)
- Platform algorithms penalize multi-variable experiments
- Single-variable tests complete faster due to smaller sample requirements
Correct answer: It allows you to attribute observed differences to a specific change with confidence
Isolating one variable ensures that any performance difference can be confidently attributed to that specific change rather than an interaction effect.
Social Media Marketing Research & Evidence-Based Practice 3
A social media manager notices engagement drops every Tuesday.
Before changing the posting schedule, what research step should they take first?