AI-native agency
Free robots.txt builder
Robots.txt
Generator
Create clean crawl directives and sitemap declarations for search bots.
Input
/ /blog
/api/ /dashboard/
https://www.example.com/sitemap.xml
Generated robots.txt
TXT
Copy
Download
User-agent: * Allow: / Allow: /blog Disallow: /api/ Disallow: /dashboard/ Sitemap: https://www.example.com/sitemap.xml
