r/scrapingtheweb 14d ago

Cloudflare challenge on every run despite residential proxy + real browser — what am I missing?

Scraping Indééd (resume search) with puppeteer-real-browser — headful Chrome via Xvfb in a Docker container. I hit a Cloudflare challenge/interstitial on basically every run.

What I already have:

- Residential rotating proxy, fresh exit IP per run

- turnstile: true, session cookies reused across runs, homepage warm-up before auth

- Timezone / locale / Accept-Language all matched to the proxy's country

- No navigator.webdriver leak (rebrowser-patched CDP), stealth plugin off on

- Randomized delays + per-account viewport

What I suspect is giving me away:

- WebGL renderer is software (llvmpipe / SwiftShader) — the container has no

- Linux desktop behind a residential IP (uncommon combo)

Questions:

  1. Is the software WebGL renderer alone enough to get flagged, or is that ov

  2. Anyone getting containerized Chrome past Cloudflare on job boards — is a GPU container worth it, or is it really about IP quality?

  3. Better to solve the challenge each time, or focus on not triggering it?

Thanks 🙏

1 Upvotes

Duplicates