robots.txt AI Audit
Paste your robots.txt and find out, bot by bot, whether ChatGPT, Claude, Perplexity and Gemini can read and cite your site.
Why robots.txt decides your AI visibility
AI assistants respect robots.txt per user-agent. The common mistake is blocking every AI bot at once: blocking training crawlers keeps you out of training data, but blocking search crawlers (OAI-SearchBot, PerplexityBot) and user fetchers (ChatGPT-User, Claude-User) removes your pages from the answers people read. This audit applies the same longest-match rules the crawlers use, entirely in your browser.