We fetch /robots.txt and show whether major AI bots are allowed to crawl your site.
/robots.txt
Tip: robots.txt usually lives at the root domain.
