Google getting even more egregious

I've known for a long time that Google is one of the worst of the bad actors on the net.

So far, I've been tolerating their crawling my FTP and HTTP export areas. Back in June, Google exhibited a different form of misbehaviour. Today's post is about them getting just plain stupid.

I haven't had /ftp in my FTP area for, well, I've lost track of exactly how long, but definitely since late September at the very latest. Yet Google is still under the impression I have it. I routinely see crawl-*-*-*-*.googlebot.com hosts connect, identifiy themselves as googlebot@google.com, do "CWD ftp", get failure, and disconnect. I went through my logs from 2022-10-02 to current and I find 115 such incidents; that's closing in on two a day (115 incidents in 64 days is 1.796875 per day). They aren't even tapering off perceptibly. I can't help wondering just how many times they are going to have to try to CWD ftp and get refused before they realize IT ISN'T THERE!

Main