Email Segmentation & A/B Testing Flashcards
7 cards from real CPM practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Email Segmentation & A/B Testing flashcards as text
A marketer notices that subscribers who open emails but never click have a very different profile from those who click through. To address this, she should create segments based on:
Answer: Engagement behavior
Engagement-based segmentation uses email interaction patterns—opens, clicks, and conversions—to group subscribers and tailor messaging accordingly.
In multivariate email testing, compared to a standard A/B test, what is the primary trade-off?
Answer: Multivariate tests require a larger audience to reach statistical significance
Testing multiple variable combinations in a multivariate test requires a much larger sample size to detect significant differences for each combination.
A marketer wants to re-engage subscribers who haven't opened an email in 90 days. The FIRST step should be:
Answer: Segment them into a win-back sequence with a compelling offer
A targeted win-back sequence with an incentive is the standard approach to re-engaging inactive subscribers before considering list removal.
Which of the following is a risk of using too-small sample sizes in email A/B tests?
Answer: Results may reflect random chance rather than true performance differences
Small samples increase the risk of Type I errors—declaring a winner due to random variation rather than a real performance difference.
A B2B company segments its email list by company size (SMB, mid-market, enterprise). This is best described as:
Answer: Firmographic segmentation
Firmographic segmentation organizes B2B contacts by organizational characteristics such as company size, industry, or revenue.
What does 'email list hygiene' contribute to when combined with segmentation?
Answer: Improved sender reputation and more accurate segment performance data
Removing invalid or inactive addresses keeps segments clean, improves deliverability metrics, and ensures test results reflect real engagement.
An e-commerce brand runs an A/B test on email body copy and declares a winner after only 4 hours. What is the main flaw in this approach?
Answer: Early results may not reflect full audience behavior due to time-of-day open bias
Ending a test too early captures only the fastest openers, who may not represent the overall audience, leading to premature and unreliable conclusions.