immediate-trans-interesting-evaluating.trycloudflare.com

https://immediate-trans-interesting-evaluating.trycloudflare.com/tools/robots-sitemap-analyzer

Give it domains. For each it parses robots.txt (user-agents, allow/disallow, crawl-delay, declared sitemaps, blocks-all) and the XML sitemap(s) (URL counts, nested sitemaps, lastmod coverage), and flags crawlability issues - with a signal and findings. Keyless, read-only. Up to 3 items per call; failed lookups are not charged.

last updated: Oct 22, 2026 · type: http · x402 v2

Payment Options

NetworkSchemeAmountPay To
Baseexact$0.04 USDC0x8d38...B120
Polygonexact$0.04 USDC0x8d38...B120

Try It