How to get all users and their statuses from a set of lists and segments daily (it's too slow)

Question

What I'm trying to do:- I have a list of Lists and Segments and I need to get all the Profiles daily pertaining to those lists (millions of entries, across multiple lists, segments and stores). How I'm doing and the problem- The problem is that it takes forever (several hours) to query 100 by 100 profiles (using pagination) by using the klaviyo.Lists.get_list_profiles and klaviyo.Segment.get_segment_profiles.- I also tried to query all profiles created at a given day filtering by day (klaviyo.Profiles.get_profiles(filter=f'less-than(created...)) so I can increment the list gradually, BUT I need to query each profile individually (with klaviyo.Profiles.get_profile_lists) to know the lists a profiles belongs to, so, it takes forever either way.  Is there a better and faster way to know, daily, the full list of profiles for all my lists?

Brian Turcotte · Accepted Answer

Hi@lml!As of now, the method you mentioned is the only one available. However, our API team is considering adding functionality to accomplish this use case more directly in future releases, so I will update the thread if anything changes there.Best,Brian

lml · Answer

Got it.Please, do update this thread as soon as you guys have an update regarding that.I really appreciate the quick reply. Thanks

Sign up

Use your Klaviyo credentials

Log in to the Community

Use your Klaviyo credentials