Topic: cloudflare pay per crawl

Cloudflare's New Marketplace Charges AI Bots for Web Scraping

Cloudflare launched Pay per Crawl, a marketplace allowing publishers to charge AI bots for scraping their content or block them entirely, addressing declining search traffic and rising AI-driven consumption. The platform offers a permission-based model, enabling publishers to set terms fo...