# CodeNx — https://codenx.com User-agent: * Allow: / # Search generates unbounded query-string URLs with no standalone value. Disallow: /search/ # Generated social cards are metadata, not content. Disallow: /og/ # Answer engines are welcome. Machine-readable index: https://codenx.com/llms.txt User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / # Aggressive SEO crawlers that provide nothing back. User-agent: AhrefsBot Crawl-delay: 10 User-agent: SemrushBot Crawl-delay: 10 Sitemap: https://codenx.com/sitemap-index.xml