User-agent: * Sitemap: https://www.ejuiceoverstock.com/sitemap.xml User-agent: * Disallow: /blog/*/feed ############## # custom # ############## # --------------------------------------------------------------- # AI crawlers # Search engine indexing is welcome. Collecting this site's # content to train generative AI models is not permitted. # --------------------------------------------------------------- # Content signal: search=yes, ai-train=no (kept as a comment: a bare Content-Signal line merged # the "User-agent: *" group into the GPTBot group below and blocked Googlebot) User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Amazonbot Disallow: / User-agent: meta-externalagent Disallow: / User-agent: Bytespider Disallow: /