Parse a site's robots.txt: whether a user-agent may crawl a path, which AI crawlers (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, CCBot...) are blocked, and declared sitemaps. Check before your agent scrapes.
| Network | Scheme | Amount | Pay To |
|---|---|---|---|
| Base | exact | $0.003000 USDC | 0xb9f0...1aCf |
| solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp | exact | 0.00 tokens | HcjfmZ...3pz2 |
| Polygon | exact | $0.003000 USDC | 0xb9f0...1aCf |
| Optimism | exact | $0.003000 USDC | 0xb9f0...1aCf |
| eip155:5042 | exact | 0.00 tokens | 0xb9f0...1aCf |