Free tool
robots.txt generator
A clean robots.txt that welcomes classic search engines AND AI crawlers — to stay visible in generated answers.
Free account required — your results show right after signup, no credit card.
- Explicit permissions for GPTBot, ClaudeBot, PerplexityBot and Google-Extended
- Automatic sitemap.xml declaration
- File ready to drop at your site root
How it works
- 1
Enter your site URL
- 2
Create your free account in 30 seconds
- 3
Get your results and recommendations