Conversion Optimization Advanced Website Conversion Optimization 4 — Questions and Answers
Question 1: A SaaS pricing page has three plans. Moving the recommended plan highlight from the middle tier to the highest tier increases average order value by 15% with no change in total conversions. Which cognitive bias explains this?
- Anchoring bias
- The compromise effect (extremeness aversion) (Correct answer)
- Loss aversion
- Choice overload
Correct answer: The compromise effect (extremeness aversion)
The compromise effect causes people to avoid extremes; framing the highest tier as the 'recommended' option shifts perception and makes the middle look like a compromise toward it.
Question 2: Which metric best measures the health of a checkout funnel across all steps simultaneously?
- Overall checkout page bounce rate
- Step-level micro-conversion rates combined into a funnel completion rate (Correct answer)
- Average time on checkout page
- Number of sessions reaching the thank-you page
Correct answer: Step-level micro-conversion rates combined into a funnel completion rate
Funnel completion rate accounts for cumulative drop-off at each step, giving a holistic view of where users abandon versus a single-step metric.
Question 3: What is the key advantage of Bayesian A/B testing over frequentist testing in a CRO context?
- It requires no prior data or assumptions
- It provides a probability that variant B is better, which is more actionable than a p-value (Correct answer)
- It eliminates the need for a holdout control group
- It automatically corrects for novelty effects
Correct answer: It provides a probability that variant B is better, which is more actionable than a p-value
Bayesian results are expressed as 'there is an X% probability that B beats A,' which is directly interpretable for business decisions unlike frequentist p-values.
Question 4: A conversion rate optimization audit reveals the site's primary CTA is below the fold on 80% of mobile sessions. What is the estimated impact category of this finding?
- Low — scroll behavior varies by user intent
- High — a CTA that requires scrolling to find creates friction for most mobile users (Correct answer)
- Medium — only affects first-time visitors unfamiliar with the layout
- Negligible — mobile users expect to scroll
Correct answer: High — a CTA that requires scrolling to find creates friction for most mobile users
If 80% of the target device segment cannot see the primary conversion action without scrolling, it is a high-priority friction point regardless of scroll behavior norms.
Question 5: Which of the following is an example of a 'post-purchase' conversion optimization opportunity?
- Reducing checkout steps to lower cart abandonment
- Optimizing order confirmation page with upsells and referral prompts (Correct answer)
- Improving product page imagery to increase add-to-cart rate
- Testing headline copy on the landing page
Correct answer: Optimizing order confirmation page with upsells and referral prompts
The order confirmation page is a high-trust moment where customers are receptive to upsells, cross-sells, and referral incentives.
Question 6: What does 'segment-level analysis' reveal that aggregate conversion rate metrics can hide?
- Total traffic volume trends over time
- Subgroups where a variant underperforms or outperforms, enabling targeted rollouts (Correct answer)
- The statistical confidence level of the overall test
- Server-side rendering performance differences
Correct answer: Subgroups where a variant underperforms or outperforms, enabling targeted rollouts
An average lift can mask that a variant wins for mobile users but loses for desktop users, requiring segment-specific decisions.
Question 7: A high-traffic blog drives 40% of a SaaS company's visitors but converts at 0.2% vs. 3.5% for direct traffic. What CRO lever is most appropriate for the blog segment?
- Increase blog post length to improve SEO rankings
- Add contextually relevant in-content CTAs and content upgrades tied to each article topic (Correct answer)
- Redirect blog traffic to the homepage for a unified experience
- Install exit-intent popups with a generic trial offer
Correct answer: Add contextually relevant in-content CTAs and content upgrades tied to each article topic
Blog visitors have topic-specific intent; CTAs that match the article content convert far better than generic or off-topic offers.
Conversion Optimization Advanced Website Conversion Optimization 4
A SaaS pricing page has three plans.
Moving the recommended plan highlight from the middle tier to the highest tier increases average order value by 15% with no change in total conversions.
Which cognitive bias explains this?