Cloudflare rolls out granular AI bot controls for search, training, and agent crawlers

Cloudflare replaces its blanket AI bot block with granular controls for search, training, and agent crawlers.

Published 1sem1 sourceNotable

≈ 23sSpeed

The fact

Website owners can now manage each bot type separately, offering more flexibility.

Starting September 15, 2026, training and agent bots will be blocked by default on ad-supported pages.

Click the link to read an article on the topic:

Explore this topic

Auto-synthesis from 1 media source · identified on July 6, 2026