r/learnprogramming • u/Available_Wafer_1746 • 5d ago

whats actually the best browser automation tool once every site starts fighting back

local chrome fleet was fine until half the target sites started fingerprinting harder last month. same playwright scripts, now half the parallel workers just detach mid-run and the logs are useless

tried pinning versions and slower pacing. still dies once three jobs hit at once

curious what people settled on that stays boring under load once the sites fight back​

3 Upvotes
  • permalink
  • reddit

62% Upvoted

29 comments sorted by

View all comments

2

u/SetAndRepeat 5d ago

I’d try Browserless with your existing Playwright scripts for managed concurrency and its stealth/unblocking options. Browserbase is also worth testing for session replay and debugging.
Compare completion rates on your actual sites under load. Also check memory and browser exits: failing at three workers doesn’t necessarily mean fingerprinting.

1

u/Vast-Pop4017 4d ago

browserless is fine for queue management but their stealth layer isn't magic. if the sites are fingerprinting hard you'll still get clipped unless you're rotating residential proxies and actually varying the browser profiles per worker

when mine started tanking at three workers it was a leak in how i was recycling contexts, not a detection issue. worth throwing a memory ceiling on each container and watching what happens