Create an A/B test

Open A/B Tests, click Create new test, pick your bundle or cart and edit Version B. Then set the traffic, click Save traffic and click Start test. Version A is always your live bundle or cart.

Before you start

• You need Plus. A free trial counts.
• The bundle must be published, or the cart must be on, before the test can start. You can build a draft first.

Create the draft

1. In Shopify admin, open Apps → Section Store → Bundles or Cart Drawer.
2. Click A/B Tests.
3. Click Bundles or Carts at the top of the page.
4. Click Create new test.
5. Pick your Bundle to test or your Cart.
6. Click Create new test. You see "The test draft was created."

You can also open a live bundle or cart in its editor and click A/B test.

Set up the versions

1. Under Versions, find Version B and click Edit version. The editor opens on that version.
2. Change what you want to test, then save.
3. To compare more, click Add version. You can have up to four versions.
4. Click Review & start test to go back to the test.

Each new version starts as a copy, so change one thing at a time. To rename the test, click the pencil next to its name.

Some settings can't differ between versions:

• Bundles: the products it shows on, its active dates and custom CSS.
• Cart: custom HTML, custom CSS and the settings that open the drawer.

Set the traffic and start

1. Under Traffic split, drag the slider or click Split evenly. Then click Save traffic. Start test uses the saved split, and the split locks when the test starts. So save first.
2. Click Preview on a version to see it on your store. Previews don't count in your results.
3. Click Start test. If Shopify asks, click Review Access Scopes and approve.

You see "The test started. Versions B–D are now locked; Version A remains editable as the live item."

After you start

• Versions B to D and the traffic split are locked.
• Version A stays editable, because it's your live bundle or cart. Don't edit it by hand during a test unless you must. Saved changes go live for Version A, shared settings change every version, and your results get harder to compare.

To change a locked version, end the test and start a new one.

If it doesn't work

• Create new test is greyed out. See Why can't I start my A/B test?
• "The test could not be updated." This bundle or cart may already have an open test. Find it in the list and open it.
• Preview is greyed out. The bundle or cart isn't live yet. Use Edit version to review it in the editor.

Related

• Run an A/B test on bundles or the cart drawer
• How does A/B test traffic split between versions?
• Read your A/B test results

Also searched as: create ab test, create a/b test, new ab test, create new test, make a split test, set up ab test, edit version b, add version, version b, start test, review & start test, test draft, start ab test, how to set up a/b test, ab test draft