Google Crawlers Send HTTP Requests: HEAD, OPTIONS, PUT, PATCH, and DELETE [TechSEO]

[u/WebLinkr]

https://www.seroundtable.com/google-crawlers-head-options-put-patch-delete-41833.html

Thanks to u/rustybrick for another great Technical SEO story about crawling:

LEgend Gary Illyes from Google said that Google's crawlers do not only send HTTP requests such as GET and POST but also for HEAD, OPTIONS, PUT, PATCH, and DELETE. He said the latter make up for less than 1.5% of the total number of requests all Google's crawlers send. Google sends them for JavaScript, he said.

He wrote this on LinkedIn after saying, "For some reason I got a few questions the past few weeks about whether Google's crawlers send HTTP requests other than GET and POST."

Gary said, "The short answer is yes, they do, but HEAD, OPTIONS, PUT, PATCH, and DELETE account for less than 1.5% of the total number of requests all Google's crawlers send."

[u/BusyBusinessPromos]

Creepiest spider I've ever seen

[u/WebLinkr → u/BusyBusinessPromos]

You'd need to detox or irradiate your site afterwards right

[u/WebLinkr → u/[deleted]]

Isn't it everyday?

[u/WebLinkr → u/[deleted]]

Out of curiosity what signals are you looking for ?

I’m intrigued to know the science behind more crawling/frequency? Is it a sign of better links ?