AI bot crawlability
GPTBot, ClaudeBot, PerplexityBot, Google-Extended, Bytespider — robots.txt + Cloudflare bot-protection detection.
AEO / GEO · 60+ checks · 6 AI agents incl. Doubao + Grok
See your site the way ChatGPT, Claude & Perplexitydo — then fix what they can't read.
Most AI-visibility tools just tell you where you stand. We audit your site as the real AI crawlers — GPTBot, ClaudeBot, PerplexityBot — and hand you the exact, paste-ready fixes, across 6 assistants, in under 30 seconds. Free, no signup.
The only audit that also covers Doubao (ByteDance) and Grok (xAI).
Free, no signup. Limit: 3 quick checks per day.
Why AI visibility matters now
Search is moving to AI answers — the data is already here
15% → 8%
Google click-through rate collapses when an AI summary appears on the results page.
Pew Research, 2025
~58%
of US Google searches now end without a single click to any website.
SparkToro, 2025
2.5×
growth in GPTBot’s share of AI crawl traffic in a single year — the AI crawlers are reading the web now.
Cloudflare, 2025
What we check
Over 60 individual checks. Each issue tagged with severity per agent, so you fix what hurts you most where it matters most.
How it works
Four steps from URL to a fix list you can ship today.
01
Drop your URL
Paste any URL. For site audits we discover your sitemap upfront so you know how many pages will be covered before we start.
02
We crawl in parallel
A real Chromium render + fetches as GPTBot, ClaudeBot, PerplexityBot, and Google-Extended — concurrently. Live progress shows pages crawled in real time.
03
We score per agent
Every issue tagged with severity (critical / high / medium / low / unknown) for each of ChatGPT, Claude, Gemini, Perplexity, Doubao, and Grok.
04
You ship fixes
Concrete recommendations grounded in vendor docs. Re-run automatically on a schedule, get alerts when scores regress, share reports publicly via signed token.
From the blog
Field guides on getting cited by AI assistants — grounded in vendor docs and data.
Frequently asked
The questions we get most often.
Which AI assistants does this audit for?
Six: ChatGPT (OpenAI), Claude (Anthropic), Gemini (Google), Perplexity, Doubao (ByteDance), and Grok (xAI). Every issue is tagged with severity per agent — so you see whether a missing canonical hurts you on Gemini critical, on ChatGPT high, or on Doubao medium — and prioritize fixes by the audience that matters.
How is this different from a regular SEO tool?
Traditional SEO tools optimize for Google search results. This tool optimizes for AI assistants — they have different signals (llms.txt, JSON-LD entity extraction, JS rendering with shorter timeouts), and different crawlers (GPTBot, ClaudeBot, PerplexityBot, Bytespider are not Googlebot). Our recommendation engine is grounded in published AI vendor docs plus observational research, with explicit confidence flags.
Do I need to install anything on my site?
No. You paste a URL; we audit from outside the way an AI crawler would. Recommendations are HTML / JSON-LD / robots.txt / llms.txt changes you make in your site's code or CMS — no agents, no scripts, no DNS changes.
How long does an audit take?
A single-page audit completes in 10–30 seconds typically. Site audits scale with page count: ~5 minutes per 50 pages with our parallel crawler. Pre-flight discovery (sitemap.xml lookup) tells you up-front how many pages your site has, before you wait. Live progress shows pages crawled in real time during the run.
What is the free quick check limit?
Three (3) quick checks per day, no signup required. Each check runs all crawlability + structure checks against a single URL. The Visible (free) plan lifts that to 5 single-page audits per month with full history. For site audits, the Indexed plan ($5/mo) unlocks 3 site audits/month at 30 pages each, and tiers above scale up from there.
What happens if my site is bigger than my plan limit?
The audit runs for the first N pages your plan covers (Indexed: 30, Featured: 50, Established: 75, Foundation: 150, Enterprise: 500). Pre-flight discovery banner tells you how many pages your sitemap declares so you know up-front whether to upgrade. Partial-data salvage means even if the run is interrupted, every page already crawled is saved and visible.
Will an AI provider penalize me for being audited?
No. We crawl as a generic browser with a standard Playwright user-agent, and as the published AI bot user-agents (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) to compare what each sees. We respect robots.txt, send a clear User-Agent, and don't hammer your server — same rate-limits as any normal visitor.
Pricing
Start free. Upgrade when you need more. Annual saves 20%.
Start free, no credit card. Upgrade, downgrade, or cancel anytime from Settings.
Layer on top of any paid plan
Standalone monthly add-ons, billed separately, cancel any time. (Bot Paywall is no longer an add-on — it's now bundled free on every paid plan from Indexed up.)
EnterpriseCustom pricing
For teams that need contractual terms, dedicated capacity, and a named account manager. Foundation handles volume; Enterprise handles procurement.
Contracts
Annual or multi-year terms, NET-30 invoicing on request, MSA / custom T&Cs / security-questionnaire support.
Capacity & priority
500-page site audits, custom API rate limits, dedicated crawler queue priority — your audits don't wait behind shared traffic.
Sign-on
SSO is custom-built per contract — not off-the-shelf. We can integrate Google Workspace, Okta, or Azure AD as part of your onboarding statement of work; timeline and price are agreed upfront. SCIM auto-provisioning is not yet available.
Account team
Dedicated CSM, response targets agreed in your contract, named technical point of contact for integration questions.