I have too many errors in my blog say 85 and the blog is under penalty. I don know how to resolve this. I just want to restrict all the URL's using robots.txt . Will it solve the issue or make things worse.
Somebody please let me know.
Too Many Crawler Errors - Can I restrict all the URL's In Robots.txt
(2 posts) (2 voices)-
To exclude all the robots from your server....edit your robots.txt file like this
To exclude all robots from the server:
User-agent: *
Disallow: /Posted 5 months ago #
Reply
You must log in to post.