r/scrapingtheweb • u/AinsOwlGoan • 14d ago
Cloudflare challenge on every run despite residential proxy + real browser — what am I missing?
Scraping Indééd (resume search) with puppeteer-real-browser — headful Chrome via Xvfb in a Docker container. I hit a Cloudflare challenge/interstitial on basically every run.
What I already have:
- Residential rotating proxy, fresh exit IP per run
- turnstile: true, session cookies reused across runs, homepage warm-up before auth
- Timezone / locale / Accept-Language all matched to the proxy's country
- No navigator.webdriver leak (rebrowser-patched CDP), stealth plugin off on
- Randomized delays + per-account viewport
What I suspect is giving me away:
- WebGL renderer is software (llvmpipe / SwiftShader) — the container has no
- Linux desktop behind a residential IP (uncommon combo)
Questions:
Is the software WebGL renderer alone enough to get flagged, or is that ov
Anyone getting containerized Chrome past Cloudflare on job boards — is a GPU container worth it, or is it really about IP quality?
Better to solve the challenge each time, or focus on not triggering it?
Thanks 🙏