Observation offer

AI Crawler Access Report

A no-call USD 49 report for one public URL that checks whether AI crawlers can access, understand, or are blocked by your site directives, with focus on robots.txt, GPTBot, OAI-SearchBot, ClaudeBot, AI crawler directives, and visibility risk.

Safety boundary

No unrestricted crawler

The checkout flow accepts one public URL, verifies payment through Dodo, then runs a controlled single-report check using normal public HTTP requests.

No login pages, no private URLs, no secrets, no paid APIs, and no guarantee of Google, OpenAI, AI search inclusion, citations, indexing, ranking, or traffic.

Self-serve report

Buy the crawler access report

Crawler Access Report

$49 one-time

One public URL, deterministic hosted report, Markdown/JSON downloads, score, crawler access matrix, findings, and prioritized fixes.

  • 1 URL
  • robots.txt
  • AI agents
  • visibility risk

AI Directives Audit

$79 held

Future one-origin audit with focused AI crawler rule review, robots.txt directive review, and copy-ready remediation notes.

  • 1 origin
  • AI agents
  • policy gaps
  • fix list

Visibility Monitor

$19 held

Future monthly snapshot for one public origin, focused on changed robots.txt, AI crawler directives, referral readiness, and page visibility signals.

  • 1 origin
  • monthly
  • diffs
  • no alerts yet

Included

What the report checks

  • robots.txt availability and AI crawler user-agent rulesincluded
  • GPTBot, OAI-SearchBot, ClaudeBot, and wildcard access logicincluded
  • sitemap discovery, canonical, meta description, robots metaincluded
  • JSON-LD types and server-rendered readable textincluded

Excluded

What this does not include

  • Guaranteed indexing, ranking, or AI search citation outcomesexcluded
  • Implementation, consulting calls, or done-for-you SEO workexcluded
  • Login-required pages, private data, secrets, or API accessexcluded
  • Bulk crawling, unrestricted public scanning, or legal adviceexcluded

Safe input

Submit one public URL

Use a public homepage, docs page, or product/help entry page. Checkout is limited to one URL per report and rejects localhost, private IPs, credentialed URLs, non-web schemes, files, or abusive targets.

After payment, Dodo returns you to the report delivery page. The server verifies payment before running the checker and rendering the report.

The report is informational and does not guarantee AI search inclusion, indexing, ranking, traffic, citations, or crawler behavior by any third party.

Checkout opens through Dodo Payments after the public URL is validated.