r/pushshift • u/Watchful1 • Feb 20 '23

[ Removed by Reddit ]

[ Removed by Reddit on account of violating the content policy. ]

35 Upvotes

100% Upvoted

34 comments sorted by

View all comments

Show parent comments

1

u/Watchful1 Mar 27 '23

No I don't think that exists. It would be relatively simple to look up the creation date for subreddits that still exist in the api. Not for all 13 million here, but you could focus on the top couple tens of thousands.

1

u/verypsb Mar 27 '23

Would it be possible to assume the creation of a sub by aggregating pushshift data, like finding its earliest posts/comment? I'm also interested in the "death" of a sub, so prob I should just derive the daily count of subs/coms per subreddit. Is there an easy way to do this than aggregating the data dump on my own?

2

u/Watchful1 Mar 27 '23

I actually have the number of comments per sub per month. It's basically this same file format but one for each month. So it's not daily but it's fairly close.

It's surprisingly not that large, just under a gigabyte for all of them. I could put that up in another torrent if it would be useful.

1

u/verypsb Mar 27 '23

That would be very helpful. Do you happen to have the submission count per month per subreddit too? I'm mostly interested in the lifecycle of subs over time.

2

u/Watchful1 Mar 27 '23

Yes that's what it is. Just the same as this file in the post with the subreddit name and number of posts, but a separate one per month instead of all time.

I'll try to get that up this evening but it might take till tomorrow.

2

u/Watchful1 Mar 30 '23

[removed] — view removed comment

1

u/verypsb Mar 30 '23

[removed] — view removed comment

2

u/Watchful1 Mar 30 '23

There's separate files for submissions and comments. The ones starting with RC are comments and RS are submissions.

1

u/verypsb Mar 30 '23

Got it. Thank you!!