3 ms·

Yay more dark patterns. /s

• mdaniel 2y ago
  > When these links are followed, we know with high confidence that it's automated crawler activity, as human visitors and legitimate browsers would never see or click them. Yeah, it would have been just stellar if I had spotted "huh, that's weird" in a page response and I chased it to see what it was. Then "har de har har, welcome to a Cloudflare blocklist, n00b" for being curious I hate them so much
  • compootr 2y ago
    I doubt they'd add these protections for visiting a handful of links at human speed. Correct me if I'm wrong, but crawlers often send hundreds of requests per minute, testing random outlinks and routes they find on the site My concern would be as a webmaster: serving useless content to users, and as a user: not getting the information from the site. I probably wouldn't use this feature, since I often deploy static websites that use little to no resources, and the potential harm outweighs the benefit
    • ccgreg 2y ago
      Cloudflare blocks Common Crawl's bot no matter how slow it goes.