Contact Us

Welcome to ineedhits Blog

Welcome to the ineedhits Search Engine Marketing blog, where we share the latest search engine and online marketing news, releases, industry trends and great DIY tips and advice.

Friday, April 21, 2006

Which Google Spider Is Crawling Your Site?

Posted by @ 12:11 am

Google's spiders constantly crawl the World Wide Web
At a recent lunch during the PubCon search engine marketing conference, unofficial Google spokesman Matt Cutts confirmed that there are two types Google spiders crawling the Web looking for indexable content for Google’s search index.

Firstly, there’s GoogleBot, the Google spider everyone knows about. Secondly, there’s MediaBot – the spider connected to Google’s AdSense program. There have long been rumours that having Google AdSense ads on your site helps improve your site ranking. According to Matt Cutt’s statements, that is most definitely NOT true – but it might help your site getting indexed in Google faster.

He also mentioned one thing that can get you into trouble real fast – if you serve different content to the two spiders (which could be done using a form of search engine spamming called cloaking). If GoogleBot is served different content to MediaBot, you run the risk of losing your listing altogether.

According to Matt, the reason for using both GoogleBot and MediaBot is the resulting savings in bandwidth costs for Google.

Need fast Google inclusion? Get listed in Google within 7 days with G-Boost. With money back guarantee!

Discussion (Not Started)

Add Your Comments


Keep up to date with the latest from our blogs.

Subscribe to all blog posts

The Newsletter

  • New Posts
  • Popular
  • Comments


More in Search News (1603 of 1797 articles)

The blog search engine IceRocket has been bought by marketing company Think Partnership. The deal is aimed at providing Think ...