I saw a similar question on this but nothing was really resolved.
I am seeing a discrepancy between flow deliverability metrics in my Dashboard and a Custom Report for the same time period.
The Open Rate in my Flows Performance Widget in my Dashboard is 25.7%, while the Open Rate from an Email Deliverability by Flow custom report is 30.85%, which is an almost 20% difference. The number of emails sent is the same, so it should be looking at the same information.
If I pull the same information for Campaigns, it matches up, so I’m not sure why Flows is different.
Excluding archived flows does not change any numbers.
Any suggestions? Thanks in advance!
Best answer by retention
@schwarze.cass - agree with @MANSIR2094, the performance can vary because the custom report could be calculated on the timeframe of “daily, week, or entire range” - so think of it this way:
If it’s daily/weekly then every day/week the open rate is calculated. And then it’s weighted average over the time period. If it’s over the time range, then they can open the email at any time in the time range.
Here’s an anecdotal example. Say you had a flow message sent to 100 people in day one.
20 people open it on day one.
10 people opened it on day two.
10 people opened in the second week after it is sent.
Here’s how the open rates differ based on the timeframe:
If you do daily, then open rate on day one is 20%, and after that those opens are not calculated since it wasn’t sent on subsequent days.
If you do weekly, then the open rate is calculated within the first week, and so the open rate is 30% (since 30 people opened in the week that the flow message was sent). And opens in the second week isn’t calculated.
If you did the entire range, then the open rate is 40% (assuming you picked a wide range that includes all 40 opens) since all 40 opens happened in the entire range.
So as you can see, the data can vary depending on how you choose the timeframe (and time zones, etc as mentioned earlier). It’s hard to line this up unless you have all the variables lined up as well.
The discrepancy might be due to how the metrics are calculated in the dashboard vs. the custom report. Dashboards often show aggregated metrics based on specific filters or time zones, while custom reports may have different calculation methods or data handling.
Double-check the following:
Ensure both the dashboard and report are using the same time zone.
Verify if the custom report includes unique opens or other advanced filtering that may affect percentages.
Confirm that all flows, including paused or archived ones, are accounted for consistently in both data sources.
If this doesn't resolve it or seems too complex, feel free to reach out for tailored assistance with setup and review!
@schwarze.cass - agree with @MANSIR2094, the performance can vary because the custom report could be calculated on the timeframe of “daily, week, or entire range” - so think of it this way:
If it’s daily/weekly then every day/week the open rate is calculated. And then it’s weighted average over the time period. If it’s over the time range, then they can open the email at any time in the time range.
Here’s an anecdotal example. Say you had a flow message sent to 100 people in day one.
20 people open it on day one.
10 people opened it on day two.
10 people opened in the second week after it is sent.
Here’s how the open rates differ based on the timeframe:
If you do daily, then open rate on day one is 20%, and after that those opens are not calculated since it wasn’t sent on subsequent days.
If you do weekly, then the open rate is calculated within the first week, and so the open rate is 30% (since 30 people opened in the week that the flow message was sent). And opens in the second week isn’t calculated.
If you did the entire range, then the open rate is 40% (assuming you picked a wide range that includes all 40 opens) since all 40 opens happened in the entire range.
So as you can see, the data can vary depending on how you choose the timeframe (and time zones, etc as mentioned earlier). It’s hard to line this up unless you have all the variables lined up as well.
This discrepancy between the Flow Performance Widget and the Custom Report might be due to the way Klaviyo calculates metrics for flows versus campaigns. Here are a few points to consider:
Attribution Windows:
The Flow Performance Widget might use a default attribution window, whereas the Custom Report could be using a different one. Verify if the same attribution windows are applied in both cases.
Metrics Breakdown:
Check if the Custom Report is using unique opens versus total opens. The Flow Performance Widget typically defaults to unique opens, while reports can sometimes show cumulative data.
Excluded Data:
Ensure that both the widget and the report are including or excluding the same data, such as skipped recipients or suppressed profiles.
Time Zone Settings:
Confirm that both the widget and the report are aligned with the same time zone settings, as time zone mismatches can affect reporting for flows that span multiple days.
Since the sent email count matches, the discrepancy likely lies in how the open rate is calculated or filtered. If these steps don’t resolve the issue, it might help to reach out to Klaviyo support with screenshots of both the Flow Performance Widget and the Custom Report for deeper analysis.
Let us know if this helps or if you need further assistance!
Have you determined the reason for this discrepancy yet?
I’d recommend checking the date range of your dashboard and the date range of your custom report. Are they both set to the same dates, in the same year? Discrepancies between the date ranges can often cause issues such as this.
Let me know if this helps, or if I can answer any follow up questions.
By clicking “Accept All Cookies,” you agree to the storing of cookies on your device to enhance site navigation, analyze site usage, and assist in our marketing efforts.
Privacy Preference Center
Your Privacy
Strictly Necessary Cookies
Performance Cookies
Functional Cookies
Targeting Cookies
Site Analytics
Your Privacy
When you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. This information might be about you, your preferences or your device and is mostly used to make the site work as you expect it to. The information does not usually directly identify you, but it can give you a more personalized web experience. Because we respect your right to privacy, you can choose not to allow some types of cookies. Click on the different category headings to find out more and change our default settings. However, blocking some types of cookies may impact your experience of the site and the services we are able to offer.
Privacy Notice
Strictly Necessary Cookies
Always Active
These cookies are necessary for the website to function and cannot be switched off in our systems. They are usually only set in response to actions made by you which amount to a request for services, such as setting your privacy preferences, logging in or filling in forms. You can set your browser to block or alert you about these cookies, but some parts of the site will not then work. These cookies do not store any personally identifiable information.
Performance Cookies
These cookies allow us to count visits and traffic sources so we can measure and improve the performance of our site. They help us to know which pages are the most and least popular and see how visitors move around the site. All information these cookies collect is aggregated and therefore anonymous. If you do not allow these cookies we will not know when you have visited our site, and will not be able to monitor its performance.
Functional Cookies
These cookies enable the website to provide enhanced functionality and personalisation. They may be set by us or by third party providers whose services we have added to our pages. If you do not allow these cookies then some or all of these services may not function properly.
Targeting Cookies
These cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.
Site Analytics
These cookies record your visit to our website, and are used to track your visit including information such as: web page interactions (clicks, hovers, focus, mouse movements, browsing, zooms and other interactions), referring web page/source through which you accessed the Sites, heatmaps and scrolls, screen resolution, ISP, and statistics associated with the interaction between device or browser and the Sites. If you are accessing our Services with a European IP address, you have been asked to consent to the use of these cookies (you are free to deny your consent).