AGI Search Labs

Free instant AEO check

Can AI crawlers read your website?

See in seconds whether the crawlers behind ChatGPT, Claude, Perplexity, Gemini, Copilot and Google AI Overviews are allowed in, and whether they can read what they find.

No email needed. We only read public files: robots.txt, llms.txt, your sitemap and your homepage.

Checking robots.txt, homepage, sitemap and llms.txt…

What the score covers, and what it doesn't

The instant check measures Access, the first of the five dimensions in our Agent Visibility Score. A site can pass every check here and still never be recommended.

  • AccessCan AI crawlers reach and read your pages?
  • QuotabilityCan a model lift a clear, specific answer from your content?
  • CorroborationDo reviews, directories, press and forums back up your claims?
  • AccuracyDoes AI describe your products, pricing, locations and certifications correctly?
  • Share of voiceHow often are you named, compared with competitors, across real buyer prompts?
Northfield Industrial SupplyIndustrial distributor, 240 employees
Sample · fictional company
37/ 100

Agent Visibility Score, across 40 buyer prompts and 6 AI assistants

Access14/20
Quotability6/20
Corroboration7/20
Accuracy8/20
Share of voice2/20
3 / 40prompts where it's named
7%share of voice (top rival: 41%)
~$480kpipeline at risk / month

See the full sample report →

Questions about the check

What does the free AI check test?

It reads your public robots.txt and reports whether the crawlers behind ChatGPT (GPTBot, OAI-SearchBot, ChatGPT-User), Claude (ClaudeBot), Perplexity (PerplexityBot), Gemini (Google-Extended), Google AI Overviews (Googlebot), Microsoft Copilot (Bingbot) and Apple Intelligence (Applebot-Extended) are allowed. It also checks whether your homepage is indexable, whether its text is readable without JavaScript, and whether you have JSON-LD structured data, a title and meta description, an XML sitemap and an llms.txt file.

Why does it matter whether my content is visible without JavaScript?

Most AI crawlers download the raw HTML of a page and don't run JavaScript. If your content only appears after scripts run, as in many single-page apps and some product configurators, those crawlers may see an almost empty page.

Is a high score enough to get recommended by AI assistants?

No. The instant check only covers crawl-readiness. Being recommended also depends on how quotable your content is, what third-party sources say about you, whether AI describes you accurately, and how you compare to competitors across real buyer prompts. The free Agent Blindness Report covers all of that.

Want the other four dimensions?

The free Agent Blindness Report shows whether AI assistants actually name you, who they name instead, what they get wrong about you, and what that costs in pipeline. Delivered in 48 hours.