Help Center

1. 

   Anonymous
   Unregistered

   Hello.

   If I host my blogspot-blog on my own server and with my own domain name, should I exclude any files or directories with robots.txt? There is an archive file puput int the root and a seperate directory for posts. Should I exclude the archive file (2008_archive... something, and is replica of index file)?

   Posted 3 years ago #
2. 

   Anonymous
   Unregistered

   you can use noindex,follow with archive files - that means search engines would follow all the links mentioned in the archives but won't index or cache any of the archive files.

   Posted 3 years ago #

RSS feed for this topic

Reply

You must log in to post.