Skip to content

Instantly share code, notes, and snippets.

@henshaw
Last active September 25, 2025 05:12
Show Gist options
  • Save henshaw/a044f97d9247389f10a82810572827e3 to your computer and use it in GitHub Desktop.
Save henshaw/a044f97d9247389f10a82810572827e3 to your computer and use it in GitHub Desktop.
Content Signals Policy for AI bots by Cloudflare for robots.txt
User-Agent: googlebot
Content-Signal: ai-train=yes, search=yes, ai-input=yes
Allow: /
User-Agent: bingbot
Content-Signal: ai-train=no, search=yes, ai-input=yes
Allow: /
User-Agent: OAI-Searchbot
Content-Signal: ai-train=no, search=yes, ai-input=no
Allow: /
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment