What it is
Cart Reward A/B Testing lets you test your reward ladder the way you’d test an ad: two versions, a 50/50 split, one winner. Your current Rewards Tiers become the Control automatically — nothing to rebuild — and you set up one Variant with the change you want to prove: a different threshold, a different discount, a different free gift, more or fewer tiers. You’ll find it in Boost Admin under Cart → A/B Tests. Schedule the test, let it run, and read the results in a report built for one question: which version made you more money?The problem it solves
Your reward tiers are the engine that grows your average order — and today, changing them is a guess:- You change the ladder and hope. Swap the $60 discount for a $75 gift, watch revenue for two weeks, and you still can’t say whether the change did it — or the ad campaign, the season, or the weekend.
- Before-and-after comparisons lie. Last month’s traffic isn’t this month’s traffic. The only honest comparison is two versions running side by side, on the same shoppers, at the same time.
- Generic A/B tools can’t touch your cart. Landing-page testing tools live outside your cart — they can’t split a reward ladder that’s wired into your cart’s pricing, gifts, and progress bar.
How it works
1. Create your test. Your current Rewards Tiers load in as the Control. You build one Variant — different thresholds, different discount values, different free gifts, more or fewer tiers, up to four. (Free shipping can be part of the test too, as long as both versions keep your live free-shipping threshold.) 2. Schedule it. Pick a start and end date and publish, or schedule it ahead — Boost starts and stops the test for you. Tests run on ET (Eastern Time) days, starting at 12:00 AM and ending at 11:59 PM. 3. Boost splits shoppers 50/50. Every cart is assigned to one version and stays on it, and both versions are locked in at launch — so mid-test edits never muddy your results. The sale is never at risk: both versions are real, working reward ladders. The test only decides which one a shopper sees. 4. Read the report, keep the winner. Test carts, conversion, revenue, and orders for each version — plus which reward tier shoppers reached before checkout. A Leading badge marks the version earning more per cart while the test runs, and the Winner is crowned when it ends.
What you get
- An answer in real dollars. Not a hunch — a side-by-side report showing which reward ladder earns more per cart, backed by real orders.
- Tier-by-tier insight. See how many carts reached each reward tier before checkout, so you learn why a ladder won — not just that it did.
- Test orders you can find in Shopify. Boost tags every test order — like
Boost Cart AB1 ControlandBoost Cart AB1 Variant— so you can filter both groups right in Shopify Admin.
Works with your stack
- Do I have to rebuild my tiers to test them? No. Your live Rewards Tiers become the Control automatically — you only build the Variant.
- What can the Variant change? Reward thresholds, discount values, free gifts, and the number of tiers — up to four, same as your live ladder. The discount type and cart requirement stay shared across both versions, and free shipping keeps the same threshold — though the Variant can move it to a different tier position.
- What about my other currencies? A test runs on one currency at a time. Every other currency keeps your live Rewards Tiers, untouched.
- Can I edit my live rewards mid-test? The tested currency’s Rewards Tiers are locked while a test is scheduled or running, so the comparison stays clean — they unlock when the test ends. Pausing also unlocks them, but if you change them, the paused test can’t be resumed.
- How many tests can I run? One cart reward test at a time. Pause or end a test whenever you want — the report keeps everything it’s learned. Resuming a paused test just needs its schedule to still be open and your live Rewards Tiers unchanged.
Ready to find your best reward ladder?
Stop guessing which rewards move the number. Run the test, read the report, keep the winner.Continue to Explore
Cart
The best cart on Shopify — home of the reward tiers you’re testing.
Checkout Upsell A/B Testing
Test your checkout upsells the same way — offer vs. offer.
Post-Purchase A/B Testing
Test your post-purchase offers too — sequence vs. sequence.