Contact Us
 
 

Welcome to ineedhits Blog

Welcome to the ineedhits Search Engine Marketing blog, where we share the latest search engine and online marketing news, releases, industry trends and great DIY tips and advice.



Monday, October 25, 2010

Why Google Failed to Index Thousands of New Pages

Posted by @ 7:28 pm
25
  •  

Google has suffered a major indexing issue that prevented thousands of new pages from being included in Google search results. Primarily affecting blogs, the bug prevented new content from being included in Google search results for a number of days.

Search Engine Land has a great example of the issue, where new content from CNN.com failed to be indexed by Google, even though the site is one of the most popular on the web.

The bug first appeared on the 19th of October and has also impacted a number of smaller sites resulting in traffic loss and concerns their sites had been penalised by Google.

We have even seen the issue impact our own blog with an article from the 21st October still not being indexed in Google’s results:

After a number of threads on Google’s webmaster help forums, a Google representative stepped in and confirmed the issue:

Just to be clear, the issues from this thread, which I have reviewed in detail, are not due to changes in our policies or changes in our algorithms; they is due to a technical issue on our side that will be visibly resolved as soon as possible (it may take up to a few days to be visible for all sites though). You do not need to change anything on your side and we will continue to crawl and index your content (perhaps not as quickly at the moment, but we hope that will be resolved for all sites soon).

Update: Google have now confirmed the issue has been fixed and indexing should now be returning to normal. Content from the 19th – 24th October may take a couple of days to be included, but there should be no issues with new content.

If you’ve seen this issue impact your site, let us know in the blog comments below.



Matthew Elshaw Matt is a marketing professional at ineedhits.com, an international search marketing firm. Matt's passion for online marketing began at university and has proved invaluable in steering product development and marketing initiatives at the company. Matt is a regular contributor to the ineedhits search marketing blog.

View Matthew Elshaw's profile






Discussion (25 - comments)

[...] Read Original Story at INeedHits.com [...]

By Why Google Failed to Index Thousands of New Pages | RM2 Project - October 25, 2010



[...] ineedhits [...]

By Why Google Failed to Index Thousands of New Pages - October 25, 2010



did this bug affect old pages, too? we lost 2/3rds of our google traffic (over 10k visitors/day) starting on the 23rd, and it was mostly older pages that seemed dropped from the index entirely, and it hasn’t been fixed yet. anyone else experience this? or did this just affect new pages?

By paul - October 25, 2010



[...] Click Here To Read Original Post on INeedHits.com SEO | SEM News [...]

By Why Google Failed to Index Thousands of New Pages « Miami Beach Web Designer - October 25, 2010



My sites lost rankings for a 42M competition keyword and is now stuck on the second page…

By aj - October 26, 2010



A lot of my pages have not been indexed by Google either http://www.isleofwighttouristguide.com

By Vicky - October 26, 2010



Thanks for giving this through to us. I couldn’t understand what was going on. I noticed an indexing issue, not just with my sites, but with the biggies as well, as you mention in the article. Now we at least know why.

Rika Susan
http://www.best-juicing.com

By Rika Susan - October 26, 2010



I agree with the post above and I will find more information from google.

By David Cobb - October 26, 2010



I noticed this to on my blog. One minute i have a lot of links and another minute poof they gone. My traffic has not dropped that much but when i check my stat’s, i notice the lost of links. The other search engines work fine for me though. I figure if the traffic did not take a nose dive, i am still in good shape and just wait and let google work it’s magic.

BTW, i found this blog post from a webmaster forum i was on.

Derek Price
http://newbizshop.com

By Derek - October 26, 2010



I no longer have any items at all showing in Google Shopping, and the number of pages in Google websearch has dropped to about 100 from several thousand. I can’t help but wonder how this is affecting my holidays sales and how long it will take to recover from this. What will it do to everyones search placement?

By Roger - October 27, 2010



I was wondering about that, I had a blog posted over 48 hours ago and it just showed up on the google alerts, my movie reviews for hereafter and paranormal activity 2 are still not showing up and I submit them to the bing url which usually brings them up within an hour or two and it’s still not working right , thurs oct 28, 2010

By Linda Randall - October 28, 2010



I think is not fully fixed as yet, because it’s happening to me too and as I read through all the post on webmaster sites, there are many people still complaining of index lost.

Jessie H.
http://www.sixtyninesecrets.com

By Jessie H. - October 29, 2010



Still not being indexed in Google Shopping (link at top of Google home page) as of this date and time. Losing lots of holiday business because I am “invisible”.

By http://www.antiques-collectibles.ecrater.com - October 30, 2010



Still not being indexed in Google Shopping (link at top of Google home page) as of this date and time. Losing lots of holiday business because I am “invisible”.
http://www.antiques-collectibles.ecrater.com

By http://www.antiques-collectibles.ecrater.com - October 30, 2010



I have lost a few ranking points, but my blog did way worse

http://www.deanmillerprints.com

By Dean Miller - November 5, 2010



November 10, 2010 and still way below normal in exposure. I wish Google was responsible enough to actually correct the problems they cause. So much for the “First do no evil” that they ripped off from the Hippocratic Oath. Imagine- they had to COPY someone elses creedo… couldn’t come up with something original on their own. Geniuses, huh? Sheesh.
http://www.antiques-collectibles.ecrater.com

By http://www.antiques-collectibles.ecrater.com - November 10, 2010



[...] This post was mentioned on Twitter by Frenchified Teena, BuildAWebsiteTonight and Apostrophe Queen, 123EasyBizPlans. 123EasyBizPlans said: ➤ Why Google Failed to Index Thousands of New Pages ➤ http://ht.ly/3b8yt ➤ [...]

By Tweets that mention Why Google Failed to Index Thousands of New Pages | ineedhits -- Topsy.com - November 17, 2010



Thanks notifying us on this. But my site wad not affected at all.
Http://www.minoxidilmax.com

By brown scout - November 17, 2010



They failed to index http://www.plastic-card.ca too !

By Khaqan - November 17, 2010



As a result of these issues I too noticed a drop in page’s. Most of our lower ranked pages completely disappeared from the face of Google while our strongest page (home page) dropped to a second page listing for certain search results. It has seemed to have gotten better but still seeing some mixed results compared to usual. Although our home page has made a significant jump back to the top as we like. I’m sure Google makes mistakes as we are all not perfect. Without a doubt Google know’s the importance of this and I’m sure they are working on the problem as I write this post. Neo Symmetry

By Neo Symmetry - November 19, 2010



[...] a month ago we wrote about a major Google indexing issue that prevented thousands of new pages from being included in Google search results. Mostly [...]

By Did Google’s Indexing Issue Hide a Secret Ranking Update? | ineedhits - November 22, 2010



[...] a month ago we wrote about a major Google indexing issue that prevented thousands of new pages from being included in Google search results. Mostly [...]

By Did Google’s Indexing Issue Hide a Secret Ranking Update? | RM2 Project - November 22, 2010



Thanksgiving day and we are still not seeing a return to normal stats at http://www.antiques-collectibles.ecrater.com. I wonder if the guys who did this to everyone would fix it if it affected THEIR families income? How about they donate 50% of their income to repairing the problem and see how they feel about that? I get the feeling these guys don’t care what harm they cause OTHER peoples families, but would scream bloody murder if it affected THEIRS.

By roger - November 25, 2010



[...] a month ago we wrote about a major Google indexing issue that prevented thousands of new pages from being included in Google search results. Mostly [...]

By Did Google’s Indexing Issue Hide a Secret Ranking Update? « Miami Beach Web Designer - November 9, 2011




Add Your Comments







SUBSCRIBE

Keep up to date with the latest from our blogs.

Subscribe to all blog posts

The Newsletter
BROWSE OUR POSTS




  • New Posts
  • Popular
  • Comments


Jobthread



More in Search News (459 of 1797 articles)


Apparently Yahoo! wants to be the next Facebook! According to the Wall Street Journal, Yahoo! will be launching a social ...