6 ms·

Could they collaborate with the website's creators that have websites behind cloudfare to allow their content to be accessed via an API in exchange of a compens

Could they collaborate with the website's creators that have websites behind cloudfare to allow their content to be accessed via an API in exchange of a compensation?. This could be a way to compensate creators and AI companies be able to access content that's unreachable as it's protected by cloudfare

lathiat 8mo ago
They are one step ahead of you: https://blog.cloudflare.com/introducing-pay-per-crawl/ https://blog.cloudflare.com/introducing-pay-per-crawl/ Sort of though. Still private beta since July 2025.