Klaviyo has recently introduced Klaviyo AI with many awesome features. 

One of the great features I've tested recently was the forms display optimization feature which allows you to cut down the time to test various variables in an automated way to find the best display timing. These are my first findings - so I'll try to update this topic as I've ran multiple of these tests.

Why I like this feature:

I'm was and still am very excited about this feature mainly because forms are the top of the funnel when it comes to email. It allows you to cut down precious thinking time and test various versions in an automated way.

Important things to know:

1. You need an account with at least 400K profiles
   since it will be running various a/b tests at the same time - statistics is what it is - you need enough traffic.
2. It will only test various display options / variations in an automated testing way
   No need to think about anything, tests will run automatically and winners will be tested against baseline.
3. Since it will test various display (timing) options make sure you don't have multiple forms triggering.

How to set this up:

1. Create a new test and choose the optimization test option - give it a name and click on Continue to test settings:

   

2. Select the distribution of the traffic - the lower you set the percentage the longer it will take. Select any advanced settings of minimum required thesholds you'd like to use.

   

   

3. The experiment will now run through various phases testing various settings and showing the end result.

First Results:

As you can see in the screenshot below we had a massive increase of almost 44% more signups in the winning variation. Believe me I had a very happy client!

This has cut down testing time by weeks if not more.

My first thoughts

While this takes down the thinking and increases speed on finding the right timing my first thoughts are - won't the shortest display time always win? How do we account for customer experience? 

I'll have to run some additional tests to see if this is the case indeed and also think about the experience of users and use the advanced sections to have a minimum threshold.

What I'd like to see next:

• Not only automate testing of display timings but also with content options
• Know what the bottom line effect is of the popup - does it also increase or decrease conversion or bounce rate? 
• Be able to use this with less profile accounts

Further reading:

• More information about Form display optimization in this Klaviyo help article
• Two awesome community champions recently posted about some findings and learnings here:

Omar Lovert // Polaris Growth // Klaviyo Master Platinum Partner

We help with e-commerce growth through CRO, Klaviyo and CVO

Let's connect on linkedin