2 ms·
That's the site owner demanding payment via cloudflare, not cloudflare unilaterally deciding to charge money (as far as I can tell at least). https://blog.clou
by 542458 1y ago
That's the site owner demanding payment via cloudflare, not cloudflare unilaterally deciding to charge money (as far as I can tell at least).
https://blog.cloudflare.com/introducing-pay-per-crawl/ https://blog.cloudflare.com/introducing-pay-per-crawl/
Looks like The Verge either set up an excessively tight pay-per-crawl policy or doesn't want IA scraping their stuff.
- incoming1211 1y agoCloudflare enabled blocking by default. People were on X complaining about it.
- thephyber 1y agoBlocking access to everyone or to scraping crawlers? They have detailed stats about the behavior of all visitors, including how bot-like they are and how likely they are to scrape your (their users’) content.