CEC Conversion Rate Optimization 4 — Questions and Answers
Question 1: What is the 'Jobs-to-be-Done' (JTBD) framework's role in CRO?
- A project management method for scheduling A/B tests
- A research lens that focuses on the underlying goal or problem a customer is trying to solve when they buy a product (Correct answer)
- A framework for hiring conversion rate specialists
- A method for measuring time-on-page metrics
Correct answer: A research lens that focuses on the underlying goal or problem a customer is trying to solve when they buy a product
JTBD reframes product messaging around the customer's core motivation, helping CRO practitioners craft copy and offers that resonate with what buyers truly want to accomplish.
Question 2: Which type of A/B test would you use to simultaneously test multiple page elements (headlines, images, CTAs) in different combinations?
- Split URL test
- Multivariate test (MVT) (Correct answer)
- Redirect test
- Sequential A/B test
Correct answer: Multivariate test (MVT)
Multivariate testing changes multiple elements simultaneously and analyzes interactions between them, requiring larger traffic volumes than standard A/B tests.
Question 3: A high 'add-to-cart' rate combined with a high cart abandonment rate most likely indicates a problem in which stage?
- Product discovery
- Product page presentation
- The checkout or payment process (Correct answer)
- Post-purchase follow-up
Correct answer: The checkout or payment process
When users add items but don't complete purchase, the friction lives in the checkout funnel — unexpected costs, required account creation, or payment complexity are common culprits.
Question 4: What is the purpose of a 'guarantee seal' (e.g., money-back guarantee badge) on a product page?
- To meet legal compliance requirements
- To reduce perceived purchase risk and increase buyer confidence (Correct answer)
- To indicate the product is in stock
- To display shipping carrier information
Correct answer: To reduce perceived purchase risk and increase buyer confidence
Risk-reversal elements like money-back guarantees lower the psychological barrier to purchase by assuring buyers they won't lose out if they're unsatisfied.
Question 5: Which customer research method involves watching real users complete tasks on your website while narrating their thoughts aloud?
- Net Promoter Score survey
- Moderated usability testing with think-aloud protocol (Correct answer)
- Cohort analysis
- Session replay review
Correct answer: Moderated usability testing with think-aloud protocol
Think-aloud usability testing surfaces qualitative insights about user confusion, hesitation, and decision-making that quantitative analytics alone cannot reveal.
Question 6: How does 'scarcity messaging' (e.g., 'Only 3 left in stock') influence conversion rates?
- It confuses users about inventory levels
- It triggers loss aversion and urgency, motivating faster purchase decisions (Correct answer)
- It reduces returns by setting expectations
- It improves SEO by adding keyword-rich content
Correct answer: It triggers loss aversion and urgency, motivating faster purchase decisions
Scarcity messaging activates loss aversion — the fear of missing out — which accelerates the decision to purchase before the item is gone.
Question 7: What is the recommended minimum sample size consideration when ending an A/B test early?
- Stop as soon as one variant shows any improvement
- Continue until you reach pre-determined statistical significance and sample size, avoiding 'peeking' bias (Correct answer)
- Stop after exactly 7 days regardless of results
- End the test when the winning variant reaches 50% conversion
Correct answer: Continue until you reach pre-determined statistical significance and sample size, avoiding 'peeking' bias
Stopping an A/B test early when results look promising (peeking) inflates false positives; pre-setting significance thresholds and sample size targets prevents misleading conclusions.
CEC Conversion Rate Optimization 4
What is the 'Jobs-to-be-Done' (JTBD) framework's role in CRO?