x402.agentharbor.agency

https://x402.agentharbor.agency/ai-crawlers

Given a website domain, reports which AI crawlers may fetch its home page under its robots.txt (RFC 9309): GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, PerplexityBot, Google-Extended, Applebot-Extended, CCBot and more, each allowed or blocked, plus Googlebot, listed sitemaps, whether /llms.txt is published and page-level noindex/nosnippet, with fixes. Static check, no browser. Not charged if robots.txt cannot be read (no response, or a bot block).

last updated: Oct 15, 2026 · type: http · x402 v2

Payment Options

NetworkSchemeAmountPay To
Baseexact$0.01 USDC0x840C...014e

Try It

Resource Activity

via Bazaar · last 30 days
Calls
3
Unique Payers
3
Last Called
Oct 15, 2026