User-agent: GPTBot User-agent: CCBot User-agent: anthropic-ai User-agent: FacebookBot User-agent: AmazonBot User-agent: Applebot-Extended User-agent: Bytespider User-agent: Baiduspider User-agent: cohere-training-data-crawler User-agent: FriendlyCrawler User-agent: img2dataset User-agent: Meta-ExternalAgent User-agent: ClaudeBot User-agent: DeepSeekBot User-agent: GrokBot User-agent: Diffbot User-agent: AI2Bot User-agent: PanguBot User-agent: Timpibot Allow: / Crawl-delay: 2 Disallow: /css/ Disallow: /data/ Disallow: /img/