URL preflight - status, redirect chain, key headers, response time, robots.txt rules for the path and sitemap location