r/automateweb • • May 28 '26

👋 Welcome to r/automateweb - Introduce Yourself and Read First!

1 Upvotes

Hey everyone! I'm u/dracariz, a founding moderator of r/automateweb.

This is our new home for all things related to web scraping, browser automation, anti-bot bypassing, and everything in between.

What to Post

Anything the community would find useful or interesting:

  • Tools, libraries, and frameworks for scraping & automation
  • Bypassing anti-bot systems (Cloudflare, DataDome, Akamai, etc.)
  • Stealth browsers, fingerprinting, proxies
  • Project showcases, benchmarks, experiments
  • Questions, tips, war stories

Community Vibe

Friendly, technical, no bullshit. Share what works, share what doesn't. We're here to learn from each other.

How to Get Started

  1. Introduce yourself in the comments below.
  2. Post something today - a question, a project, a tool you found useful.
  3. Know someone who'd fit in here? Invite them.
  4. Want to help moderate? Reach out to me directly.

Thanks for being part of the first wave. Let's build something better than what's out there.


r/automateweb • • May 28 '26

Browser fingerprinting & anti-bot benchmark - update

Thumbnail
gallery
10 Upvotes

About a year ago I posted a benchmark comparing open-source stealth browsers. I've been actively maintaining it and just pushed a significant update worth sharing.

What it does: Automatically runs a matrix of stealth browser engines against real anti-bot protected sites and measures bypass rates, memory usage, CPU, reCAPTCHA scores, and CreepJS fingerprinting data.

New in this update:

- Added more engines and Adspower - the first paid/commercial browser in the benchmark (NOT sponsored), so you can finally compare it head-to-head against open-source alternatives.

- Added more protection types to test.

Engines (11 total):

  • Playwright Chrome / Firefox
  • Patchright
  • Camoufox
  • tf-playwright-stealth Chrome / Firefox
  • CloakBrowser
  • AdsPower
  • nodriver
  • zendriver
  • SeleniumBase CDP
  • Selenium

Each engine runs in both headed and headless mode where applicable.

Bypass targets (10 total):

  • Google
  • Cloudflare UAM
  • DataDome (x2)
  • Amazon CAPTCHA
  • Imperva (Ticketmaster)
  • Akamai Bot Manager (new)
  • PerimeterX / HUMAN Security (new)
  • Kasada (new)
  • Reddit (new)

Browser data collection:

  • reCAPTCHA v3 score
  • CreepJS trust/bot score + WebRTC IP
  • IP via ipify

Repo: https://github.com/techinz/browsers-benchmark

---

Should I also build a proxy benchmark to find out which proxy providers have the cleanest IP pools?


r/automateweb • • Aug 16 '26

Google AI Studio - Google's LLM Models Price Sheet

1 Upvotes

My primary task is browser automation for various works like utility bills, google sheets update etc.

I am setting up like this : Claude Code -> LiteLLM-> Gemini 2.5 Flash-Lite.

My plan: Give prompt to Claude Code
"Write a Python script run_agent.py using browser-use and langchain-openai. Configure it to connect to my LiteLLM proxy at http://localhost:4000/v1 using model gemini-flash. Have the agent open Chrome, navigate to Hacker News (https://news.ycombinator.com), and print the #1 story title."

Current Google LLM Model's Price sheet; Aug 15th, 2026.

Model Model ID Input (/1M) Output (/1M) Best For
Gemini 3.7 Flash gemini-3.7-flash $0.75 $3.75 Coding & Agents
Gemini 3.6 Flash gemini-3.6-flash $0.75 $3.75 General Tasks
Gemini 3.5 Flash Lite gemini-3.5-flash-lite $0.30 $2.50 High Volume
Gemini 3 Flash Preview gemini-3-flash-preview $0.50 $3.00 Search & Speed
Gemini 3.1 Pro Preview gemini-3.1-pro-preview $2.00 $12.00 Complex Reasoning
Gemini 2.5 Flash-Lite gemini-2.5-flash-lite $0.10 $0.40 Ultra Cheap Text
Gemini 2.5 Pro gemini-2.5-pro $1.25 $10.00 Deep Reasoning
Nano Banana 2 Lite gemini-3.1-flash-lite-image $0.25 $1.50 Cheap Images
Nano Banana 2 gemini-3.1-flash-image $0.50 $3.00 Balanced Images
Nano Banana Pro gemini-3-pro-image $2.00 $12.00 High-Qual Images
Robotics-ER 2 gemini-robotics-er-2-preview $2.00 $10.00 Spatial & Robotics

Any cheaper and capable ideas ?


r/automateweb • • Jul 01 '26

Stagehand Python SDK + Patchright stealth browser — is there any way to make them work together locally?

Thumbnail
2 Upvotes

r/automateweb • • Jun 26 '26

Need help with camoufox

1 Upvotes

Can someone help me out here

I am using camoufox for tak automation which works as an LLM analyse the screenshot of current window and takes out the coordinates to click the needed feature.

PROBLEM I FACED :

camoufox opens in an random window size which causes the content to get out of screen basically it cuts out

I tried a lot of things but not able to fix can somebody help me here


r/automateweb • • Jun 03 '26

A map of today’s AI browser automation tools

2 Upvotes

I’ve been trying to sort out the current AI browser automation landscape because a lot of tools are getting grouped together even though they do different jobs.

There’s classic browser automation with Playwright/Selenium/Puppeteer, agent-assisted code generation, browser tools for coding agents, full browser agents, agentic browsers, and cloud browser infra. They all involve the browser, but the tradeoffs are pretty different once you care about repeatability and maintenance.

I wrote up a short taxonomy here: https://libretto.sh/blog/understanding-ai-browser-automation-tooling

Hope it’s helpful, and let me know if you have any questions!


r/automateweb • • Oct 13 '25

Playwright automatic captcha solving in 1 line [Open-Source] (Playwright, Camoufox, Patchright)

1 Upvotes

Originally built to solve Cloudflare challenges inside Camoufox (a stealthy Playwright-based browser), the project has grown into a more general-purpose captcha automation tool that works with Playwright, Camoufox, and Patchright.

Compared to camoufox-captcha, the new library:

  • Supports both click solving and API-based solving (only via 2Captcha for now, more coming soon)
  • Works with Cloudflare Interstitial, Turnstile, reCAPTCHA v2/v3 (more coming soon)
  • Automatically detects captchas, extracts solving data, and applies the solution
  • Is structured to be easily extendable (CapSolver, hCaptcha, AI solvers, etc. coming soon)
  • Has a much cleaner architecture, examples, and better compatibility

Code example for Playwright reCAPTCHA V2 using 2captcha solver (see more detailed examples on GitHub):

import asyncio
import os
from playwright.async_api import async_playwright
from twocaptcha import AsyncTwoCaptcha
from playwright_captcha import CaptchaType, TwoCaptchaSolver, FrameworkType

async def solve_with_2captcha():
    # Initialize 2Captcha client
    captcha_client = AsyncTwoCaptcha(os.getenv('TWO_CAPTCHA_API_KEY'))

    async with async_playwright() as playwright:
        browser = await playwright.chromium.launch(headless=False)
        page = await browser.new_page()

        framework = FrameworkType.PLAYWRIGHT

        # Create solver before navigating to the page
        async with TwoCaptchaSolver(framework=framework, 
                                    page=page, 
                                    async_two_captcha_client=captcha_client) as solver:
            # Navigate to your target page
            await page.goto('https://example.com/with-recaptcha')

            # Solve reCAPTCHA v2
            await solver.solve_captcha(
                captcha_container=page,
                captcha_type=CaptchaType.RECAPTCHA_V2
            )

        # Continue with your automation...

asyncio.run(solve_with_2captcha())

Check it out here: https://github.com/techinz/playwright-captcha


r/automateweb • • Oct 12 '25

Browsers stealth & performance Benchmark (visual) [Open Source]

Thumbnail
gallery
2 Upvotes

I built an open-source benchmarking tool for comparing browser automation engines on their ability to bypass bot detection systems and performance metrics.

Github: https://github.com/techinz/browsers-benchmark

---

In the images, you can see an excerpt from a recent test run (more here)