AI Crawler Log Analyzer
Paste your server access log and see which AI bots (GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot...) actually visit your site, how often and what they read.
How to read your log for AI crawlers
Every AI assistant identifies itself with a user-agent: training crawlers (GPTBot, ClaudeBot, Google-Extended) collect pages for future models, search crawlers (OAI-SearchBot, PerplexityBot) build the index that answers cite, and user fetchers (ChatGPT-User, Claude-User, Perplexity-User) load a page when someone asks about it. Export the last days of your Nginx or Apache access log, paste it here and you will see which of them reach you, which pages they read and whether your server answers them with errors.