What I'm trying to do:
- I have a list of Lists and Segments and I need to get all the Profiles daily pertaining to those lists (millions of entries, across multiple lists, segments and stores).
How I'm doing and the problem
- The problem is that it takes forever (several hours) to query 100 by 100 profiles (using pagination) by using the klaviyo.Lists.get_list_profiles and klaviyo.Segment.get_segment_profiles.
- I also tried to query all profiles created at a given day filtering by day (klaviyo.Profiles.get_profiles(filter=f'less-than(created...)) so I can increment the list gradually, BUT I need to query each profile individually (with klaviyo.Profiles.get_profile_lists) to know the lists a profiles belongs to, so, it takes forever either way.
Is there a better and faster way to know, daily, the full list of profiles for all my lists?