Hi Klaviyo Community,
First-time poster here, hoping to get some expert eyes on a confusing A/B test result we're seeing.
We're currently running a campaign for a new product launch called "Fruit Boom". We decided to A/B test our standard, simple email template (Version A) against a new, more visually-driven template we've developed internally, codenamed the "ModHello" template (Version .
The results are baffling us:
- Version A (Old, Simple Template): Is performing as expected, with a Click-Through Rate (CTR) of around 4.2%.
- Version B (New "ModHello" Template): Is performing terribly, with a CTR of only 0.7%.
We were convinced Version B would be the winner as it's more colorful, modern, and has some nice interactive-looking elements. We've already checked the usual suspects:
- All links in both emails point to the correct URL and are working.
- Both versions look great on mobile and desktop (tested on multiple devices).
- The subject line is identical for both versions in the test.
To give you the full context of the user journey, this is the landing page that the email directs to. We felt the email design in Version B was a better match for the page's vibrant feel, but the numbers are telling a different story.
Landing Page:
https://modhello.com/fruit-boom/ |
Our team is stumped. Are we missing something obvious here? Maybe the "ModHello" design is too distracting and pulls attention away from the Call-To-Action? Has anyone experienced such a dramatic drop in performance when trying to "upgrade" their email design?
Any advice or theory on what to investigate next would be a massive help.
Thanks in advance!