Cloudflare is launching a new marketplace that reimagines the relationship between publishers and AI companies.

Cloudflare’s Pay-Per-Crawl is a clever idea. It’s the first genuine attempt to attach a meter to data before it gets ...

Cloudflare takes a stand on AI crawlers, which could enable publishers to finally make peace with the bots scooping up their ...

The age of the AI scraping free-for-all may be coming to an end. At least if Cloudflare gets its way.

Cloudflare says it manages traffic for 20% of the web and "trillions of requests daily," which may be enough to take a meaningful bite out of AI companies' crawlers.

On Tuesday, the internet infrastructure company Cloudflare announced that it will block AI bots from scraping data from its sites without opt-in permission. Cloudflare hosts about 20 percent of the ...

Roughly 16% of global internet traffic goes directly through Cloudflare's CDN, the firm estimated in a 2023 report. "AI crawlers have been scraping content without limits.

Cloudflare, one of the world’s largest internet infrastructure providers, has begun blocking AI web crawlers by default unless they receive direct permission from site owners. This new policy changes ...

Starting Tuesday, every new web domain that signs up to Cloudflare will be asked if they want to allow or block AI crawlers. At least 16% of the world's internet traffic gets routed through ...