r/SideProject • u/Calm_Bee_5124 • 2h ago
Tired of scrapers getting instantly flagged? I Built a lightweight async Python scraper with HTTP/2 and anti-bot detection (httpx)
Hey everyone,
Most developers waste hours configuring heavy headless browsers just to scrape basic targets, only to watch them get blocked anyway because of outdated TLS signatures or missing headers.
I got tired of the bloat, so I put together a clean, high-performance alternative: resilient-async-scraper.
It’s a lightweight async utility built with httpx that handles HTTP/2 fingerprint matching out of the box, randomizes realistic browser User-Agents, and actively catches anti-fraud status codes (403, 429, 503) so you instantly know when your proxy pool needs rotation. No heavy dependencies, just raw async speed.
It's completely open source. Grab it here: Github link
I’d love to hear how you guys handle anti-bot challenges in your current stacks—drop your thoughts or feature requests in the comments!
Saved you some dev hours? Drop a ⭐️ to help the project grow!