# Search engines and AI search/answer agents may crawl everything, so pages can be found and # cited. Crawlers that collect training data for AI models are refused (ADR 0008). User-agent: * Allow: / User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: CCBot User-agent: Bytespider User-agent: meta-externalagent Disallow: / Sitemap: https://mohzulfikar.com/sitemap-index.xml