3 ms·
Pay per crawl: Enabling content owners to charge AI crawlers
- mmarian 1y agoWrote a blog post on why I don't think it'll be adopted: https://developerwithacat.com/blog/202507/cloudflare-pay-per-crawl/ https://developerwithacat.com/blog/202507/cloudflare-pay-per... tldr - motivated scrapers can pass Cloudflare, content owners won't be happy with the market price, and enterprise licensing agreements already fill whatever gaps there are
- miohtama 1y agoThis is why OpenAI is building their own browser. When the AI-managed requests are initiated by the user itself, from his browser, from his computer, it is more difficult to block and monetise them (except of course by OpenAI itself).