Back to all tools
SEO Tools
Robots.txt Generator
Create a custom robots.txt file to guide search engine bots on how to crawl and index your website effectively. Prevent indexing of sensitive directories.
robots.txt
User-agent: * Allow: / Disallow: /wp-admin/ Disallow: /temp/
Warning: Incorrect instructions in robots.txt can lead to your entire website being removed from Google search results. Double check your disallow paths.