CHEAPUNO guide

Does A/B test use conversion rate or add-to-cart rate?

Check your A/B test metrics before rollout. Using add-to-cart instead of conversion rate hides real revenue impact.

What you are probably seeing

Your dashboard shows a lift in cart additions, but your revenue per visitor remains flat or drops slightly.

You notice the winning variant drives more carts, yet the checkout completion rate for those carts is significantly lower than the baseline.

Why it happens

The experiment optimization target was likely set to add-to-cart events, which measures intent but not committed purchase value.

Add-to-cart is an earlier funnel step where user friction is lower, so it captures more noise from abandoned carts than final sales.

What changed recently

Step by step

1. Review the original experiment brief to identify which primary metric was used for the test readout.

2. Pull the post-hoc revenue data for both variants to compare actual orders and average order value.

3. Calculate the net revenue impact by multiplying the change in conversion rate by the revenue per transaction.

4. Consult your analytics team to determine if the add-to-cart lift can be statistically linked to future purchase behavior.

5. Re-run the test with conversion rate set as the sole primary metric before approving a permanent rollout.

Ways to go further

Affiliate links: CHEAPUNO may earn a commission if you buy through them, at no extra cost to you.

Other problems readers raise

Why does my checkout total not match the advertised price?

How to find and fix friction points on your landing page?

Is my website ready for AI agents and Core Web Vitals?

Why does my checkout cap feel like a bait-and-switch?

Why customers abandon checkout when delivery costs are hidden