robots.txt Generator
Build a clean robots.txt from user-agents, allow/disallow rules and sitemaps.
About this tool
Add as many user-agent groups as you need, list allow / disallow paths and sitemap URLs, and copy the generated robots.txt straight to your site root.