Help Center

1. 

   Anonymous
   Unregistered

   Labels in Bloggers seems to be blocked by robots.txt files(suggested by google Webmaster Tools). Therefore these labels can't be find by users on search engines.

   does any one know how to crawl blogger labels in to serach engines.

   Thanks,
   Amit

   Posted 4 years ago #
2. 

   Anonymous
   Unregistered

   yes, any URLs like labnol.blogspot.com/search are not indexed by search engine bots due to restrictions in robots.txt.

   probably google is doing this to prevent indexing of duplicate content.

   this auto-setting is kind of good for most blogs else they run the risk of getting penalized for serving same content on multiple pages.

   Posted 4 years ago #
3. 

   Anonymous
   Unregistered

   k,
   Thanks for the help.
   cheers,
   Amit

   Posted 4 years ago #
4. 

   Anonymous
   Unregistered

   You cannot do anything about it.

   Had it that, you wanted an unindexed page to get indexed on google, you could use the meta robots tag. But as admin said its good not to index the labels tag since your posts are already on the index(i assume), its safe not to have the labels as it will create duplicate content.

   hey think this way - if google set it - its most likely for your good. ;)

   Cheers!
   Mani

   Posted 4 years ago #

RSS feed for this topic

Reply

You must log in to post.