Originally reported bytheverge
Cloudflare is set to introduce a significant policy change, effective September 15th, targeting automated bots that simultaneously crawl ad-supported websites for both search engine indexing and artificial intelligence (AI) model training.
This strategic move is designed to encourage AI companies to utilize distinct crawlers for their separate operational purposes. The ultimate aim is to empower website publishers with greater control and discretion over which automated agents are permitted to access their digital content.
#AI News#Cloudflare#Bot management#AI crawlers#Website control
ES
Editorial Staff
The Editorial Staff at AIChief is a team of professional content writers with extensive experience in AI and marketing. Founded in 2025, AIChief has quickly grown into the largest free AI resource hub in the industry.
View all posts
What did you think of this story?
User Comments
Filter:
No comments yet. Be the first to comment!