Why Google do Not Index all Your Webpages in Sitemap XML File?

A lot of time people complain about Google not indexing all the URLs submitted to Webmaster tool through a valid Sitemap XML file.

Check up your stats as how many URLs are there in your Sitemap XML file submitted to Webmaster tool and how many have been index by Google. Sometime the difference may be so much that it can give you big heartache. Well Google already clear the air in this regard that they do not index everything in the Sitemap. But why?

When asked the same to Google’s senior engineer Matt Cuts, here is what he says;

Well, the rough answer is, just including stuff in a Sitemap file dose not guarantee that we’ll crawl all of them. And there are a lot of people who look at how much of the Sitemap was indexed and try to say, “Oh, you’re not indexing all of it. Something’s broken. You have to index 100% of the stuff in my Sitemap.”

We’ve never made the guarantee that Google will crawl everything in the Sitemap file. If you wanted to have more pages crawled, the best way to do is to get known as a little more of an authority, to get more reputation, essentially through the process of getting more links –Links that are trusted. So if you pay attention to that, I would look at the traffic that’s coming to your site –which should hopefully be on the increase. I would look at things like your conversion rates and trying to make sure that the visitors who land on your page convert well.

I wouldn’t get hung up on just how many pages have been indexed from the sitemap file. Just because you can list them doesn’t mean that we’ll automatically index them. If you do want more pages indexed, the typical way is get to be known better around the web which is typically links –that’s the number one way that we often find new files or, new webpages of new document around the web.

In nutshell -to get more of your webpages index by Google you need to concentrate on following;

1. Build yourself an authority on your niche
2. Get more quality and relevant back links
3. Get more traffic.
4. Reduce bounce rate, which mean your readers hang up there for a while.

These are few method to please Google baby to index more of you in their search giant’s brain.

4 Responses to “Why Google do Not Index all Your Webpages in Sitemap XML File?”

1. Suresh Khanal says:

   September 4, 2010 at 11:19 am

   Reducing bounce rate really indicates how useful your visitors find your site useful. A useful site must have been indexed by google too!

   Good suggestions.

   Reply
2. Harsh Agrawal says:

   September 8, 2010 at 5:06 pm

   These days something is really wrong with search engine crawlers…I have been noticing few of my blog posts are not getting indexed in search engine and only random posts… I started a thread for the same in Webmaster help forum and hope to get an answer soon for the same….

   Reply
3. Sachin Bisaani says:

   September 9, 2010 at 4:29 pm

   Google has now upgrade its search engine, with instant search, let hope for good changes.

   Reply
4. Shabnam Sultan says:

   September 13, 2010 at 1:02 am

   I am also facing this problem as few of my webpages are not being indexed by Google.

   Reply