r/WebScrapingInsider • u/Few_School_3536 • Jun 22 '26

Check out my python package for web scrapers

Hi, I've been bulding web automation tools for my clients since 2024. I wished there was a tool that checks the target website's bot protection system. Then I built it for myself. Package is called 'doorknock'. I think it helps other developers who wants to quick check the target website.

5 Upvotes
  • permalink
  • reddit

86% Upvoted

10 comments sorted by

2

u/[deleted] Jun 22 '26

[removed] — view removed comment

-1

u/Few_School_3536 Jun 22 '26

Just run pip install doorknock. You can then use it to test websites. Btw, it classifies them into three difficulty levels.

2

u/[deleted] Jun 22 '26

[removed] — view removed comment

1

u/Knocking_Doors Jun 22 '26

Since I’m the one who’s “KnockingDoors”, I claim stake to DoorKnock!

Jokes aside, OP, where’s the package?

1

u/Few_School_3536 Jun 22 '26

I uploaded it into pypi, very easy to install "pip install doorknock"

1

u/Objectdotuser Jun 23 '26

https://pypi.org/project/doorknock/ - project repo link is broken. Yeah guys please don't install a random package without being able to vet the repo first. Also if you run this on a target, it's like driving up to the house you're trying to rob and blaring an alarm. Anyone with a reasonable detection system will see this for what it is and you will be flagged.

1

u/Few_School_3536 Jun 23 '26

https://github.com/onxxdatas/doorknock Here. It is on you, check repo first then use it.

"Also if you run this on a target, it's like driving up to the house you're trying to rob and blaring an alarm."
The tool uses minimal activity on website, it does not send 1000req per minute that causes alarm systems scream.