4 ms·
>We've detected unusual activity from your computer network To continue, please click the box below to let us know you're not a robot. Looks more like automate
by dexen 8y ago
>We've detected unusual activity from your computer network To continue, please click the box below to let us know you're not a robot.
Looks more like automated protection against scrapping, or perhaps DDoS-like access patterns. Bloomberg certainly could, and ought to, add an exception for Archive.org, but iI wouldn't read any nefarious intent to the current state of affairs.
On the other hand, Archive.is and similar work just fine [1], given that they download the website via your computer rather than via centralized servers.
[1] http://archive.fo/TkpaJ http://archive.fo/TkpaJ
- 3xblah 8y agoIt looks like they may be using Perimeterx Bot Defender. Note Bloomberg is not blocking any access without Javascript or cookies enabled. Perimeterx is a service that purports to stop "bots" by using heuristics to produce a "risk score". The result is that it allows some bots (e.g. Googlebot) and blocks others (e.g. Archive.org_bot). It gives preferential treatment to some http clients such as Chrome while blocking others such as curl or wget. Not only that, as you mention, these blocks are bypassed simply by using an open redirect. The page you quoted is telling the user to enable Javascript and cookies, making it sound like that is the reason for the block. The truth is that javascript is only needed so the user can solve captchas and send data to Google. One does not need JS or cookies enabled to read Bloomberg articles.