North American Network Operators Group

Date Prev | Date Next | Date Index | Thread Index | Author Index | Historical

Re: Paging Google's Googlebot developers re. bugs

  • From: Jeff Rosowski
  • Date: Mon Nov 14 12:27:47 2005

Googlebot keeps ignoring my robots.txt file, thereby hammering the server and facilitating spam.

I think I found at least 2 bugs; see this thread in the robots.txt forum thread:

I've used Google's direct contact form last Wednesday; still no ack or response.

Please don't reply w/o reading the above thread, to avoid repetition.
I'm looking for a fix, not a workaround (such as a temporary total Googlebot ban).
Requires you to register to read it.  Sorry.