Contact Us

Welcome to ineedhits Blog

Welcome to the ineedhits Search Engine Marketing blog, where we share the latest search engine and online marketing news, releases, industry trends and great DIY tips and advice.

Monday, August 10, 2009

Check Your NoIndex/NoFollow Content – Bing Might Have Crawled It

Posted by @ 7:03 pm

bing-logoAccording to a post on WebProNews, Microsoft has admitted a problem with Bing whereby pages marked as NoIndex or NoFollow are being accessed incorrectly.

NoIndex/NoFollow are Meta Tags that can be used to advise search engine spiders to avoid indexing a web page. There are a number of reasons why you might want to use these tags such as avoiding duplicate content or hiding more private details.

The tags are currently supported by other major search engines like Google and Yahoo, so the issue appears to be impacting Bing only. Here’s what Brett Yount from Bing’s webmaster team had to say:


This is a known issue we are working quickly to resolve. If you have pages you would like permanently removed from our index, please send me a mail to with your domain name and “MSNBot ignoring robots tags” in the subject line. Please also include the URLs in the body of the message. You may use an * wildcard for any directories such as: wrongdirectory/*

Normally, I would request that you fill out a content removal request, however, since this is a problem on our side, I’ll do the leg work for you.

If you’ve got pages using these tags I’d recommend checking them in Bing and taking appropriate action if they’ve been accessed incorrectly. If you’re after other ways to prevent spiders from indexing your content check out the other methods supported by the Robots exclusion standard.

Matthew Elshaw Matt is a marketing professional at, an international search marketing firm. Matt's passion for online marketing began at university and has proved invaluable in steering product development and marketing initiatives at the company. Matt is a regular contributor to the ineedhits search marketing blog.

View Matthew Elshaw's profile

Discussion (1 - comment)

hi there ,

the way to catch up the no index pages is to use robots txt .

By Manas Kumar - June 25, 2010

Add Your Comments


Keep up to date with the latest from our blogs.

Subscribe to all blog posts

The Newsletter

  • New Posts
  • Popular
  • Comments


More in Search Engines, Search News (723 of 1797 articles)

Not to be outdone by the recent Bing/Yahoo! partnership and Facebook acquisition of FriendFeed, Google have gone one step further ...