Skip to main content
Quick Guide
4 min read

Drive maximum impact with smart A/B testing

Do more of what works, and less of what doesn’t. Use Smart A/B testing features in Klaviyo to get all of the benefits of testing, without sacrificing conversions.

Let AI help you do more of what works

Marketing teams who drive consistently strong performance frequently test and iterate on their content strategy through A/B testing. Klaviyo AI enables you to run smarter A/B tests by calculating the statistical significance of your test results, giving you win percentage estimates, and automatically directing recipients to the best-performing content. See how it works across various types of A/B tests in Klaviyo.

Campaigns

When you run an A/B test on message content in campaigns, you can choose how much of your audience should participate in the test. By doing this, you can show the winning content variation to the most subscribers. To determine a winner, Klaviyo uses machine learning to observe the patterns of how recipients interact with the test variations.

__wf_reserved_inherit
A preview of a campaign A/B test

Flow messages

When you A/B test message content inside of a flow, Klaviyo will use AI to automatically distribute traffic toward the winning variation as it gains confidence in the result. This allows you to serve the best version of content to the most recipients.

__wf_reserved_inherit
A preview of an email A/B test inside of a flow

Sign-up forms

When you A/B test a form, you can allow Klaviyo AI to select the winner once statistical significance is reached, and then automatically deliver the winning content variation to the remainder of your audience. This way, you can continuously optimize your content without sacrificing conversions by letting AI show the best performing variation to the largest possible audience.

A preview of a sign-up form A/B test

Always be testing (with smart A/B tests)

Explore the different types of smart A/B tests that you can run in Klaviyo. While you should test often, be sure that you are never testing more than 1 variable at a time.

Email subject lines

You can test email subject lines for both email campaigns and emails that are inside of flows. Test subject line to see which copy generates the highest open rate.

When you run an A/B test on subject lines, you should keep the content inside the messages constant between variations. Changing the content in addition to could cause a difference in deliverability between variations, which may skew your results or make them less reliable.

Campaign content

You can test email and SMS campaign content to see what your subscribers want to click on.

Note that if you run an A/B test for email content, you should not change the subject lines between the variations. Hold the subject line constant so you can measure the impact of the content.

Flow message content

Just like message content in campaigns, you can also test email and SMS content in your flow messages. This will help you understand which content in your flow messages is generating the most clicks or most attributed orders.

Sign-up forms

You can test form design, incentives and offers, or display options using an A/B test. Test different variables to see if you can increase your form submit rate.

Campaign send time

For both email and SMS campaigns, you can test different send times to see if they show a lift in engagement around a particular time of day.

Drive maximum impact with smart A/B testing
Back to all resources