Easiest way to get events per profile using API (for all profiles)?

Hi there,

It sounds like you're dealing with a data extraction challenge. Here's my suggestion

I understand the complexity of fetching event types and times per user for all profiles. Instead of fetching all profiles and all events separately and running multiple queries, consider exploring the following approach:

1. Batch API Requests: Check if the API you're using supports batch requests. This way, you can fetch information for multiple profiles and events in a single API call, reducing the number of requests and speeding up the process.

2. Optimize API Queries: Review the API documentation to see if there are parameters or filters that allow you to retrieve the desired data more efficiently. For example, you might be able to filter events based on user IDs to directly get the relevant information.

3. Use Data Transformation Tools: Consider using data transformation tools like Apache Spark or pandas in Python. These tools can help you process and transform large datasets efficiently, allowing you to reshape the data as needed for your analysis.

4. Caching and Incremental Updates: If applicable, implement a caching mechanism to store previously fetched data. This way, you only need to retrieve and process new or updated information, saving time and resources.

5. Parallel Processing: Depending on the scale of your data, explore parallel processing techniques to fetch and process data concurrently. This can significantly speed up the overall data export process.

Remember to consult the API documentation thoroughly and test any changes in a controlled environment before implementing them in a production setting. If you have any specific details about the technology stack you're using, I can provide more targeted advice.

Message me for further discussion

Best regards,

Juan.

@saulblum, I am in the same boat as Dan. Where can I find access to a bulk download of all profiles with all their event data? The context is I need to quickly access that data, which Klaviyo’s user interface doesn’t allow for, and whose API documentation doesn’t explain how to access.

There isn’t a UI way to do a bulk export of events. You’d need to call Get Events for each metric you care about: https://developers.klaviyo.com/en/reference/get_events

What’s the use case for doing a bulk export of every event?

Thank you for your response. While I understand that the platform’s UI currently doesn’t offer bulk export functionality, the volume of data required makes pulling events metric by metric unmanageable.

Could you advise if there are any alternative solutions or potential API enhancements that would allow for a bulk export? This would significantly improve our ability to work within your platform, so if there are any options or alternative approaches you could suggest to streamline this process, we’d greatly appreciate it.