Free tool
Is your site blocking AI search?
Enter your website. In a few seconds see which of 13 AI crawlers from OpenAI, Anthropic, Perplexity, Google, Microsoft, Apple, Meta and Common Crawl your robots.txt allows.
Free. No sign-up. Reads your public robots.txt, llms.txt and sitemap only.
What this checks
AI search crawlers (OAI-SearchBot, ChatGPT-User, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User, bingbot) fetch pages so AI assistants can answer questions and cite sources. If they are blocked, those assistants can't read your pages.
AI training crawlers (GPTBot, ClaudeBot, Google-Extended, Applebot-Extended, CCBot, meta-externalagent) collect content for model training. Blocking them is a legitimate choice and does not block AI search crawlers.
We read only public files (robots.txt, llms.txt, sitemap) and use no AI. Rules follow RFC 9309. This check can't see firewall or CDN bot blocking. See the full methodology.
Crawlers are step one. Get the full audit.
One payment, no subscription. The first 300 licences are $99, then $119. 14-day money-back guarantee.