Hive Wiki: Could The Google Spider Destroy Your Site
The HiveWiki Dictionary - Definitions: Wiki:
(wih-kee) (n.) 1. Flexible website alternative to blogs!
2. Collaborative, fun to develop, community-oriented website.
(v.) 3. To easily create a website without knowing HTML.
(do it!) 4. Setup New Free And Easy Hive Wiki Today!
Home | Edit | Index | Recent Changes

Internet: Articles: Could the Google Spider Destroy Your Site?

A story on iNeedHits talked about "Google's Spider of Death":
  • For most website owners, many of their search engine optimization efforts are aimed at getting Google's spider to visit their website on a regular basis..... In a case of "be careful what you wish for", a website owner experienced the full wraith of the [GoogleBot]Create? recently. After engaging a web development firm to implement a content management system for their existing website, a month of painstaking development was swiftly undone when Google's spider essentially killed the newly re-developed web site.... The spider is designed to follow each hyperlink on a page, including those with "Delete Page" in the title. The net result; [GoogleBot]Create? systematically went through the site and deleted everything.
Garnet Responds:

This is hilarious! A friend who worked at IBM in the good old days of room sized computers had a small placard from IBM on his desk, it only had one word on it: "Think"

This article doesn't give any solutions for how to avoid this problem, so let me give a couple of very simple things to keep in mind:

  1. Keep commands with disasterous consequences behind a login, or otherwise unspiderable place.
  2. Use form buttons instead of links for thinks like edit, save, etc. Form buttons are generally not spiderable.
Using straight HTML links for content management editing might look nice, but they are an open invitation for this kind of disaster not only from Google, but any kind of web-whacking downloader software.

 - Garnet, developer of Free Hive Wiki, Chat11

Fresh copy to be cached until 7:22:02 PM
541 hits

This Page: Edit | History
This Wiki: Home | Related To Could_The_Google_Spider_Destroy_Your_Site | Index | Recent Changes | Random Page | Search
Login | Create New Wiki | Wiki List
8/21/2008 11:22 AM v0.61.106 ADBEFEED
Wiki Site Resource List 78ms