AI Crawler robots.txt Tester

Paste your robots.txt to instantly see which AI engines (ChatGPT, Claude, Perplexity, Gemini, Copilot…) can crawl your site. Blocking these bots makes you invisible in AI search.

AEOGEO16 AI bots

Your robots.txt

Should you allow AI crawlers?

For most businesses: yes. If you want ChatGPT, Perplexity and Claude to cite your brand, their bots need to read your pages. Blocking GPTBot or Google-Extended removes you from those answer engines entirely. Only block them if you have a specific reason to opt out of AI training/search.