Skip to main content
Apr 7

GoDaddy Sites Now Control AI Crawler Access.

A leading web hosting platform is partnering with Cloudflare to incorporate the latter's advanced AI Crawl Control tool. This innovative solution prov

1 min read85 views3 tags
Originally reported bytheverge

A leading web hosting platform is partnering with Cloudflare to incorporate the latter's advanced AI Crawl Control tool. This innovative solution provides publishers with granular control over how web crawlers engage with their sites, enabling them to either permit, block, or even request payment from various bots accessing their content.

This collaboration follows Cloudflare's earlier initiative, which saw the company begin blocking AI crawlers by default across its network starting last year.

ES
Editorial StaffEditor

The Editorial Staff at AIChief is a team of professional content writers with extensive experience in AI and marketing. Founded in 2025, AIChief has quickly grown into the largest free AI resource hub in the industry.

View all posts
Reader feedback

What did you think of this story?

User Comments

Filter:
No comments yet. Be the first to comment!
Continue reading
View all news