The Google Webmaster Tools dashboard has graphs indicating the activity of Google spiders on your websites. You get to know the number of pages that were crawled by Googlebots per day and some other details.
To see such graphs for your own website, open Google Webmaster Tools, go to Tools and then click Set Crawl rate.
Now if you look at the crawling stats for April in for your site, you may find that Google is spidering lesser number of web pages on your site. I checked this for two of my sites and the graphs followed a similar trend as the one above.
Since fresh content (or new web pages) almost immediately gets indexed in Google, this trend probably means that Google spiders are revisiting older web pages (pages already in Google’s index) at a much lower frequency.
Brett Tabke feels that Google was focused on some new ranking changes during April and a lot of their spidering and indexing was throttled during that period. Makes lot of sense.
Find this article at: http://www.labnol.org/internet/search/google-spiders-got-lazy-crawled-less-web-pages/3114/
Reader Comments
Yeah way down for me too! Slight up curve towards the end of the graph though so maybe it’s coming back…
Written by Aseem Kishore on 05.01.08
yeah a small glitch is there in my blog also
Written by Technoogy Hacker on 05.01.08
Same here… and the faster option is also disabled.
Written by PChere on 05.01.08
Yup… noticed the same… I agree with the PageRank theory. A friend of mine woke up a couple of days ago to find that his PR is now 5 all of a sudden (from 3).. and my blog’s PR which I had lost some time ago to 0 was reinstated to 3 a couple of days ago..
Written by Vaibhav on 05.01.08
Good to know this Amit, but recently a couple of days back booglebots blocked my blog as a spam blog! Am so surprised and disappointed with this wrong BLOGGER glitch.. it was perhaps wrong on the first step to consider hosting a high quality business /career blog on blogspot. Well we all learn by our mistakes but was quite sure of Google’s blogger and it’s reputation..
But best to blog on the personal website than those hosted free…
Would you share some tips on this issue?
Thanks!
Written by Shweta on 05.01.08
Yes..I too find the same..The adsense income is too low in april compared to the last two year monthly adsense income…i fear is that too a reason… or will this new ranking from google continue to kill us ?
Written by A.K.Ravishankar on 05.01.08
I too find the same…The adsense income is too low in april compared to the last two year monthly income..is this new ranking a reason for low income? will this new ranking system continue to kill us ?
Written by A.K.Ravishankar on 05.01.08
Good to learn about this. I’m at a starting point with my blog, only 10 new visitors a day – until a couple of days ago. Then all in a sudden the traffic I’ve got via Google stopped completely. And it takes now seven days instead of three to get indexed … At first I thought I was being “blacklisted” because of some keywords found on my pages (a paranoid idea?).
Written by Learnmore Disa on 05.01.08
While checking the google activity last month i found something similar. I knew i had made no changes to my sites so it was something to do from google’s end. Maybe updating their algorithm or something but now it seems to be normal.
Written by SticKer on 05.01.08
Crawlers at my blog too went down that precipise.
Written by Vinayak on 05.01.08
Yes Google bots got little bit slower. The faster option is disabled if your site is crawling up to th mark. It is enabled if your site’s crawling is less than normal.
Written by Hemu on 05.02.08
Yeah it has also happened with me. First i thought this is penalty from google!!!
Written by Ronak Bhagdev on 05.02.08