AI crawler access (live probe)
Your firewall or CDN is blocking at least one AI crawler — those assistants can't read or cite your site.
What this means
Passing: AI crawlers can reach your site — none of the major bots are blocked at the edge.
Partial: An AI crawler got a denied response, but we couldn't confirm it's a deliberate firewall block (it may be transient).
Needs work: Your firewall or CDN is blocking at least one AI crawler — those assistants can't read or cite your site.
Allow AI crawlers through your firewall / CDN
Your edge (WAF/CDN) returned a block to an AI crawler's User-Agent, so assistants like ChatGPT, Claude, and Perplexity can't read your pages. Allowlist the verified AI bots in your firewall's bot rules. Note: this is measured from our IP using each bot's User-Agent — it catches User-Agent filtering, not IP-range allowlisting.
Want the exact, copy-paste snippet for your own site? Run a free audit and sign in to see it in your report.
Full guide
Step-by-step for your platform, with why AI engines read it and how to confirm it worked: WAF / Cloudflare bot allow.