Pay per Crawl

Entity category: technology

Artificial Intelligence

Cloudflare’s New Marketplace Charges AI Bots for Web Scraping

July 1, 2025

Matthew Prince, CEO of Cloudflare, smiles while speaking at a conference.

Cloudflare launched Pay per Crawl, a marketplace allowing publishers to charge AI bots for scraping their content or block them…