Google Spiders Got A Bit Lazy in April; Crawling Lesser Web Pages
The Google Webmaster Tools dashboard has graphs indicating the activity of Google spiders on your websites. You get to know the number of pages that were crawled by Googlebots per day and some other details.
To see such graphs for your own website, open Google Webmaster Tools, go to Tools and then click Set Crawl rate.
Now if you look at the crawling stats for April in for your site, you may find that Google is spidering lesser number of web pages on your site. I checked this for two of my sites and the graphs followed a similar trend as the one above.
Since fresh content (or new web pages) almost immediately gets indexed in Google, this trend probably means that Google spiders are revisiting older web pages (pages already in Google’s index) at a much lower frequency.
Brett Tabke feels that Google was focused on some new ranking changes during April and a lot of their spidering and indexing was throttled during that period. Makes lot of sense.
Subscribe in a reader
Yeah way down for me too! Slight up curve towards the end of the graph though so maybe it’s coming back…
yeah a small glitch is there in my blog also
Same here… and the faster option is also disabled.
Yup… noticed the same… I agree with the PageRank theory. A friend of mine woke up a couple of days ago to find that his PR is now 5 all of a sudden (from 3).. and my blog’s PR which I had lost some time ago to 0 was reinstated to 3 a couple of days ago..
Good to know this Amit, but recently a couple of days back booglebots blocked my blog as a spam blog! Am so surprised and disappointed with this wrong BLOGGER glitch.. it was perhaps wrong on the first step to consider hosting a high quality business /career blog on blogspot. Well we all learn by our mistakes but was quite sure of Google’s blogger and it’s reputation..
But best to blog on the personal website than those hosted free…
Would you share some tips on this issue?
Thanks!
Yes..I too find the same..The adsense income is too low in april compared to the last two year monthly adsense income…i fear is that too a reason… or will this new ranking from google continue to kill us ?
I too find the same…The adsense income is too low in april compared to the last two year monthly income..is this new ranking a reason for low income? will this new ranking system continue to kill us ?
Good to learn about this. I’m at a starting point with my blog, only 10 new visitors a day - until a couple of days ago. Then all in a sudden the traffic I’ve got via Google stopped completely. And it takes now seven days instead of three to get indexed … At first I thought I was being “blacklisted” because of some keywords found on my pages (a paranoid idea?).
While checking the google activity last month i found something similar. I knew i had made no changes to my sites so it was something to do from google’s end. Maybe updating their algorithm or something but now it seems to be normal.
Crawlers at my blog too went down that precipise.
Yes Google bots got little bit slower. The faster option is disabled if your site is crawling up to th mark. It is enabled if your site’s crawling is less than normal.
Yeah it has also happened with me. First i thought this is penalty from google!!!