Configure AI bot policies: New defaults on September 15, 2026 (developers.cloudflare.com)

Cloudflare has announced that starting September 15, 2026, new default settings will restrict certain AI bots on customer domains. Bots categorized as Training or Agent will be blocked on pages with advertisements, while Search bots will still be permitted. This update aims to enhance user control over AI interactions by allowing customers to tailor their bot management strategies. Before the implementation date, existing customers can opt out of these new defaults. The significance of this change lies in its potential impact on the AI and machine learning community, particularly concerning data usage and bot behavior management. Cloudflare’s configuration options enable users to block bots based on their function—such as indexing content, real-time interactions, or training AI models. Each option includes mitigation strategies like blocking across all pages or specifically on ad-displaying pages. By empowering customers with this level of customization, Cloudflare is responding to growing concerns about AI data scraping while encouraging responsible AI deployment practices.