Free tool
AI Crawl Checker
Can ChatGPT, Claude, Perplexity and the other AI assistants read your website? We read your robots.txt, request the page as each AI crawler, and show what they get.
robots.txt
Read the way crawlers read it: groups, several user agents, Allow against Disallow, wildcards.
A live request per crawler
Twenty AI crawlers, each with its own user agent, plus a normal browser to tell a block from a site that is down.
What the page gives them
Text in the HTML or loaded by script, noindex, schema.org, title, description, headings, llms.txt and the sitemap.
No AI is used in the check: every verdict is a rule over the answers our requests got. How to read the result