Do you really want Google’s spider of death to visit your website?
For most website owners, many of their search engine optimization efforts are aimed at getting Google’s spider to visit their website on a regular basis. It’s assumed that the more regularly the GoogleBot visits, the more up-to-date your search engine listings will be. And generally, regular visits by Google’s spider are a sign that your website is viewed quite highly by the search engine.
In a case of “be careful what you wish for”, a website owner experienced the full wraith of the GoogleBot recently. After engaging a web development firm to implement a content management system for their existing website, a month of painstaking development was swiftly undone when Google’s spider essentially killed the newly re-developed web site.
While the disastrous impact GoogleBot’s visit is alarming, it can’t be held totally to blame. It is fair warning for anyone with a poorly programmed site.
The spider is designed to follow each hyperlink on a page, including those with “Delete Page” in the title. The net result; GoogleBot systematically went through the site and deleted everything. Not all was lost, as the prudent back-up of the previous site was soon re-published to fill the void in the spider’s wake.
So if you don’t wish for GoogleBot to make a disappearing trick of your web pages, especially if you have a content management system controlling your website, then it might be timely to check your page links and ensure you’re not leaving your website open to the destructive power of Google’s spider.
Post To Del.icio.us