← All CPM Flashcard Decks

Email Segmentation & A/B Testing Flashcards

7 cards from real CPM practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.

Read the first 7 Email Segmentation & A/B Testing flashcards as text
  1. A marketer notices that subscribers who open emails but never click have a very different profile from those who click through. To address this, she should create segments based on:

    Answer: Engagement behavior

    Engagement-based segmentation uses email interaction patterns—opens, clicks, and conversions—to group subscribers and tailor messaging accordingly.

  2. In multivariate email testing, compared to a standard A/B test, what is the primary trade-off?

    Answer: Multivariate tests require a larger audience to reach statistical significance

    Testing multiple variable combinations in a multivariate test requires a much larger sample size to detect significant differences for each combination.

  3. A marketer wants to re-engage subscribers who haven't opened an email in 90 days. The FIRST step should be:

    Answer: Segment them into a win-back sequence with a compelling offer

    A targeted win-back sequence with an incentive is the standard approach to re-engaging inactive subscribers before considering list removal.

  4. Which of the following is a risk of using too-small sample sizes in email A/B tests?

    Answer: Results may reflect random chance rather than true performance differences

    Small samples increase the risk of Type I errors—declaring a winner due to random variation rather than a real performance difference.

  5. A B2B company segments its email list by company size (SMB, mid-market, enterprise). This is best described as:

    Answer: Firmographic segmentation

    Firmographic segmentation organizes B2B contacts by organizational characteristics such as company size, industry, or revenue.

  6. What does 'email list hygiene' contribute to when combined with segmentation?

    Answer: Improved sender reputation and more accurate segment performance data

    Removing invalid or inactive addresses keeps segments clean, improves deliverability metrics, and ensures test results reflect real engagement.

  7. An e-commerce brand runs an A/B test on email body copy and declares a winner after only 4 hours. What is the main flaw in this approach?

    Answer: Early results may not reflect full audience behavior due to time-of-day open bias

    Ending a test too early captures only the fastest openers, who may not represent the overall audience, leading to premature and unreliable conclusions.