# robots.txt for thescentnest.com # Content signals (https://contentsignals.org/): search and AI answers with # attribution are allowed; training AI models is not (EU Directive 2019/790 art. 4). User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / Disallow: /tsnadmin Disallow: /api/ Disallow: /cos Disallow: /finalizare-comanda Disallow: /contul-meu Disallow: /en/cart Disallow: /en/checkout Disallow: /en/my-account Disallow: /*?*sort= Disallow: /*?*filter # AI answer and citation crawlers — explicitly welcome User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: Applebot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / Disallow: /tsnadmin Disallow: /api/ # Training-only crawlers User-agent: GPTBot User-agent: ClaudeBot User-agent: CCBot User-agent: Google-Extended User-agent: Applebot-Extended Disallow: / Sitemap: https://thescentnest.com/sitemap_index.xml # LLM guide (Romanian + English): https://thescentnest.com/llms.txt · https://thescentnest.com/llms-full.txt