I have too many errors in my blog say 85 and the blog is under penalty. I don know how to resolve this. I just want to restrict all the URL's using robots.txt . Will it solve the issue or make things worse.
Somebody please let me know.
Too Many Crawler Errors - Can I restrict all the URL's In Robots.txt
(2 posts) (2 voices)-
Anonymous
UnregisteredPosted 2 years ago # -
Anonymous
UnregisteredTo exclude all the robots from your server....edit your robots.txt file like this
To exclude all robots from the server:
User-agent: *
Disallow: /Posted 2 years ago #
Reply
You must log in to post.