User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: Google-Extended Allow: / User-agent: GPTBot Allow: / User-agent: Claude-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Slurp Allow: / User-agent: DuckDuckBot Allow: / User-agent: YandexBot Allow: / User-agent: Applebot Allow: / User-agent: AhrefsBot Allow: / User-agent: SemrushBot Allow: / User-agent: facebot Allow: / User-agent: * Allow: / Disallow: /api/ # /en/* serves the same content as /* (Next.js i18n keeps the default locale # unprefixed but still resolves /en/*). Pages self-canonicalise to the # unprefixed URL; this keeps crawlers off the duplicates entirely. Disallow: /en/ Disallow: /en$ Allow: /.well-known/ Crawl-delay: 1 Sitemap: https://blockchain-development-solutions.com/sitemap.xml