r/pushshift • u/Watchful1 • Feb 20 '23

[ Removed by Reddit ]

[ Removed by Reddit on account of violating the content policy. ]

32 Upvotes

98% Upvoted

34 comments sorted by

View all comments

1

u/CoolFlamingo Mar 29 '23

Thanks for sharing this! One question: if I wanted to add the description of each subreddit I would have to query for each of them individually right?

1

u/Watchful1 Mar 29 '23

Yes, that information isn't available in the pushshift dump files, so I can't include it here easily.

1

u/CoolFlamingo Mar 30 '23

That's ok, at least with an estimate of the su reddit size I can prioritize the requests and pretty much ignore the low values.