Cloudflare Blog · Cloud · 2026-08-21
Say it once: introducing Bot Preference Sync
Cloudflare's new Bot Preference Sync automatically aligns your robots.txt file with your AI bot policies for Search, Agent, and Training. Easily manage which bots access your content without maintaining static files. Say it once: introducing Bot Preference Sync
Read original on Cloudflare Blog Get the app
Licensed summary · LicensedSummary
Related briefs
- AWS Glue 6.0 now available with 30% lower price and full Apache Iceberg v3 support
- From all-or-nothing to task-based OAuth consent
- Kubernetes at the edge has hit a wall. Fleet management is the way through.
- A revisit of remote Spectre attacks on Cloudflare Workers
- BGP Role model: tracking the adoption of RFC 9234