Robots.txt Optimization Tool
Mistakes you make in your robots.txt can seriously impact your site and that's why a lot of people avoid it all together.
Just enter a domain or URL and click Go. Our Robots.txt optimization tool will fetch your current robots.txt file, along with any resources that can be affected by it. It will then show you which resources are blocked and which rule in your robots.txt is affecting them. You can edit your robots.txt and see the changes applied to your resources in real time. Once you get everything looking just right, just copy the edited robots.txt and away you go!