Is a specific bot allowed to fetch a URL? Fetches the site's robots.txt and evaluates the path for the named user-agent (GPTBot, ClaudeBot, Googlebot, Bingbot, CCBot, PerplexityBot or any token), returning allowed/disallowed, the matching rule and group, crawl-delay, and whether the bot has a dedicated group or falls back to *. Pre-flight for compliant scraping agents. $0.01 per check.
| Network | Scheme | Amount | Pay To |
|---|---|---|---|
| Base | exact | $0.01 USDC | 0x91D5...0abd |
| Base Sepolia | exact | $0.01 USDC | 0x91D5...0abd |