# Bloqueo explícito de bots de IA y scrapers que consumen Fast Origin # Transfer / Edge Requests sin aportar tráfico real al sitio. User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: OAI-SearchBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Claude-Web Disallow: / User-agent: anthropic-ai Disallow: / User-agent: PerplexityBot Disallow: / User-agent: Amazonbot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: PetalBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: SerpstatBot Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: Meta-ExternalFetcher Disallow: / User-agent: FacebookBot Disallow: / User-agent: Diffbot Disallow: / User-agent: YouBot Disallow: / # Bots legítimos (Google, Bing, DuckDuckGo, etc.) tienen acceso completo # salvo a rutas privadas / de auth donde no hay nada que indexar. User-agent: * Allow: / Disallow: /api/ Disallow: /admin Disallow: /admin/ Disallow: /auth/ Disallow: /login Disallow: /registro Disallow: /restablecer-contrasena Disallow: /recuperar-contrasena Disallow: /perfil Disallow: /perfil/ Disallow: /buscar? # Evita que indexen combinaciones infinitas de filtros (ord, et, p, q, etc.) # que serían cache misses constantes en ISR/SSR sin valor SEO real. Disallow: /*?*ord= Disallow: /*?*inv= Disallow: /*?*cmp= Disallow: /*?*hsr= Disallow: /*?*rord= Disallow: /*?*rinv= Disallow: /*?*rmat= Disallow: /*?*back= Disallow: /*?*p= Disallow: /*?*pg= Disallow: /*?*pas= Disallow: /*?*acc= Disallow: /*?*asi= Disallow: /*?*exp= Disallow: /*?*tar= Disallow: /*?*et= # Crawl-delay ayuda a no saturar (Bing/Yandex respetan; Google lo ignora). Crawl-delay: 5 Sitemap: https://www.notechifles.app/sitemap.xml