User-agent: ClaudeBot Disallow: / User-agent: facebookexternalhit Disallow: / User-agent: meta-externalagent Disallow: / User-agent: Scrapy Disallow: / User-agent: * Disallow: