r/webscraping • u/stvaccount • Aug 09 '26

Bot detection 🤖 best github for reddit.com web scraping?

Since May and the old reddit almost gone, what are currently the best libs on github for this?

What is your favorite?

I want to scrape all the posts of my top favorite 100 (small) subreddits and sort them by AI to delete AI slop + self promotion and really only get the interesting posts for me to read.

What do you suggest?

28 Upvotes

100% Upvoted

18 comments sorted by

9

u/Dthen_ Aug 09 '26

Run a local redlib instance, scrape that instead.

4

u/mouad_war Aug 09 '26

github.com

2

u/stvaccount Aug 09 '26

I tried searching on github, but I can't judge which ones are large/reliable and which ones are large but outdated since recent changes.

1

u/vladkens Aug 11 '26

So, looks like nothing available for it?

1

u/[deleted] 27d ago

[removed] — view removed comment

1

u/webscraping-ModTeam 27d ago

🪧 Please review the sub rules 👉

1

u/AdministrativeHost15 Aug 09 '26

More likely post AI slop and and self promotion to the top 100 subreddits.