Check whether a domain allows AI usage of its content before you crawl: parses robots.txt Content-Signal and aipref directives (search / ai-input / ai-train) into structured JSON with a plain-English interpretation. Essential pre-flight for scraping, RAG, and training-data agents — especially after Cloudflare's Sept 15, 2026 default gating.
| Network | Scheme | Amount | Pay To |
|---|---|---|---|
| Base | exact | $0.005000 USDC | 0x8503...9432 |