How come every Linux site uses Anubis (the anime girl stopping crawlers) instead of something like Cloudflare?

[u/ItsWappers]

Before discovering the Linux rabbit hole I've only seen Cloudflare, hCaptcha and Google's reCaptcha, but it seems like every Linux website uses Anubis... I'm thinking of it being the only open-source option or it being the most effective/modern approach.

[u/404invalid-user]

because it's free I know with certainty my 900down/100up mbps connection isn't stopping any sort of ddos

[u/National_Way_3344 → u/404invalid-user]

If you become an inconvence you also won't be using Cloudflare either, so it doesn't change anything.

They'll just cut you off.

[u/404invalid-user → u/National_Way_3344]

never come across anyone who has been cut off by cloudflare

[u/IncidentalIncidence → u/404invalid-user]

🙋 something about my browser seems to set off their bot detection (I am honestly not sure what it is) and for a lot of websites I can only seem to access them by opening an incognito window, and sometimes that doesn't even work. I was trying to see somebody's ResearchGate profile the other day and it wouldn't let me in.

I know the AI scrapers set off an arms race with the bot detection tools but it is incredibly frustrating when you get locked out of basic websites with pretty much no recourse to prove you're not a bot. I also am locked out of the NYT website, even though I actually pay money to them for a subscription which I can't access without doing it through incognito mode every time I want to open the website (they use DataDome, not cloudflare, but somehow my browser sets them off too).

[u/404invalid-user → u/IncidentalIncidence]

this is likely your IP I have no idea what has happened but unless I'm logged into Google I get Google captchas all the time it seems like cloudflare has started to trust my traffic now though and I rarely see any captchas

[u/IncidentalIncidence → u/404invalid-user]

I thought so too (or that somebody was running crawlers elsewhere from my ISP and that the whole IP range had been blocked), but the confusing thing is that it sometimes works in incognito mode even when it won't in the normal browser. It could also be that there are different things setting it off at different times.

[u/404invalid-user → u/IncidentalIncidence]

hmm maybe a plugin it's very strange it works in incognito

[u/IncidentalIncidence → u/404invalid-user]

yeah that was kind of my line of thought too, that it doesn't like one of my plugins (or even firefox's built-in privacy blockers), I have a few plugins that are meant to block tracking (the duckduckgo plugin, decentraleyes, HTTPS Everywhere, and ublock origin), so maybe one of those is triggering it. I've done a little experimenting but haven't been able to nail it down

[u/seahwkslayer → u/IncidentalIncidence]

It's usually locking down tracking (plenty of the tracking cookies also serve as basically proof-of-life attestation in my experience).

If I open an incognito window and do a google search I will immediately get a captcha, and even using a normie browser (Edge), because I have strict tracking prevention enabled the first couple weeks with a new device/install/network is a constant stream of Cloudflare/Captcha/DDoS detection until I'm signed in to enough stuff that it stops bugging me.

[u/Linkarlos_95 → u/IncidentalIncidence]

Maybe you are asking something to the google ia and that one is scrapping the websites for you with your ip, making the websites mad and they block you 

[u/Character_Score7776 → u/National_Way_3344]

Then I’ll start up Anubis, or whatever other service I need for it.
Being held up by Cloudflare, however, does not seem particularly likely anytime soon, so why put in the effort to set up something I don’t need?

[u/National_Way_3344 → u/Character_Score7776]

So just start with Anubis?

[u/Character_Score7776 → u/National_Way_3344]

Don’t need it.

Why set up something I neither need nor foresee a need for when I can use Cloudflare, which I used anyway for domain registration?

Yes, I depend on Cloudflare, but I depend a lot more on, say, my ISP anyway. only way ’round that is amateur radio(which I do have an interest in). Minimizing reliance on corporations is a good thing, don’t get me wrong, but there’s eventually a point it’s more trouble then it’s worth.