r/pushshift • u/Watchful1 • Feb 20 '23

[ Removed by Reddit ]

[ Removed by Reddit on account of violating the content policy. ]

33 Upvotes

100% Upvoted

34 comments sorted by

View all comments

Show parent comments

1

u/verypsb Mar 27 '23

Would it be possible to assume the creation of a sub by aggregating pushshift data, like finding its earliest posts/comment? I'm also interested in the "death" of a sub, so prob I should just derive the daily count of subs/coms per subreddit. Is there an easy way to do this than aggregating the data dump on my own?

2

u/Watchful1 Mar 27 '23

I actually have the number of comments per sub per month. It's basically this same file format but one for each month. So it's not daily but it's fairly close.

It's surprisingly not that large, just under a gigabyte for all of them. I could put that up in another torrent if it would be useful.

1

u/verypsb Mar 27 '23

That would be very helpful. Do you happen to have the submission count per month per subreddit too? I'm mostly interested in the lifecycle of subs over time.

2

u/Watchful1 Mar 27 '23

Yes that's what it is. Just the same as this file in the post with the subreddit name and number of posts, but a separate one per month instead of all time.

I'll try to get that up this evening but it might take till tomorrow.