robots.txt AI Audit
Paste your robots.txt and find out, bot by bot, whether ChatGPT, Claude, Perplexity and Gemini can read and cite your site.
Get the full AI-visibility report for your site
This tool checks one thing. The full scan checks everything ChatGPT, Perplexity, Gemini and Claude look at, scores it, and re-checks your site every month by email. Free, no account.
Only emails about this domain, no spam. Unsubscribe anytime.
Need daily monitoring, more sites or white-label reports? See plansWhy robots.txt decides your AI visibility
AI assistants respect robots.txt per user-agent. The common mistake is blocking every AI bot at once: blocking training crawlers keeps you out of training data, but blocking search crawlers (OAI-SearchBot, Claude-SearchBot, PerplexityBot) and user fetchers (ChatGPT-User, Claude-User) removes your pages from the answers people read. This audit applies the same longest-match rules the crawlers use, entirely in your browser.