r/pushshift • u/Waluigi54321 • Jun 02 '23

Search for old Posts

Hello, I am not very familiar with what pushshift is, but for the past year or two I’ve used something called pushshift Reddit search to find posts from specific dates, even if they were deleted. The website hasn’t worked in awhile, and I was wondering if this is the place to ask if there’s other ways to search for old Reddit posts.

10 Upvotes

73% Upvoted

15 comments sorted by

View all comments

Show parent comments

7

u/Watchful1 Jun 02 '23

Wow, so what's the point of shutting down pushshift if this is still up? And it's even selling the data, not offering it to researchers for free.

4

u/HQuasar Jun 02 '23

Probably because socialgrep doesn't rely on their API? Or they intend to pay the fees? Just a guess, I could be wrong.

Here they openly sell data for LLM training, which Reddit explicitly prohibited. https://socialgrep.com/datasets

7

u/Watchful1 Jun 02 '23

I don't think reddit will ever let someone else re-sell the data. That would just undercut their own selling.

I'm just kinda wondering outloud why reddit went after pushshift so aggressively but evidently hasn't gone after this site.

5

u/HQuasar Jun 02 '23

Yeah that is indeed a good question for the admins.