Email Segmentation & A/B Testing Flashcards
7 cards from real CPM practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Email Segmentation & A/B Testing flashcards as text
A marketer creates separate email tracks for subscribers who prefer educational content vs. those who prefer promotional offers. Which segmentation basis is this?
Answer: Psychographic / preference-based
Segmenting by content preference or mindset aligns with psychographic segmentation, which groups people by attitudes, interests, and values.
What is the primary purpose of a 'holdout group' in email testing?
Answer: To measure the baseline conversion rate of subscribers who receive no email
A holdout group receives no email, allowing marketers to isolate the incremental lift attributable to the campaign versus organic behavior.
An A/B test is designed to compare two different email layouts. Which element should remain IDENTICAL in both variants?
Answer: The audience segment, send time, and all content except the layout
To attribute results to the layout change, all other variables—audience, timing, and content—must remain constant between the two variants.
Which of the following is the best indicator that an email segmentation strategy is working?
Answer: Segmented campaigns show higher open and conversion rates than unsegmented blasts
Segmentation success is measured by improved engagement and conversion performance compared to sending the same message to everyone.
What is the risk of 'over-segmentation' in email marketing?
Answer: Segments become too small to achieve statistical significance in tests or to justify unique content creation
Extremely narrow segments may lack enough contacts to yield statistically valid test results or to justify the operational cost of creating unique content.
A marketer sees that the email variant with the longer subject line (52 characters) significantly outperformed the shorter one (28 characters) in A/B testing. What is the BEST follow-up action?
Answer: Apply the longer subject line approach to future campaigns for this audience and monitor ongoing results
A/B test results are audience- and context-specific; the winning approach should be applied and monitored rather than universalized as a permanent rule.
Which of the following scenarios represents 'sequential A/B testing' rather than a fixed-horizon test?
Answer: Continuously monitoring test results and stopping the test as soon as significance is reached
Sequential testing (also called 'peeking') involves stopping the test dynamically when a significance threshold is met, rather than at a pre-set endpoint.