4 ms·

An earlier ruling actually ordered LinkedIn to stop attempting to block the scraping using technological measures, too.

• perl4ever 7y ago
  Has robots.txt been outlawed now? In what jurisdiction exactly?
  • sjg007 7y ago
    I don't believe that robots.txt has ever had the backing of law.
  • jjeaff 7y ago
    Robots.txt doesn't restrict anything. It's just a request of what should and shouldn't be scraped by search engine spiders.
• zuminator 7y ago
  I believe that LinkedIn were enjoined from using measures to limit HiQ specifically from scraping their site, not from general authorization-based measures that might have the corollary effect of limiting access by HiQ. The idea is that LinkedIn can't make the data public and freely accessible and then turn around and say that the data isn't public if you're a potential competitor who is using an automated tool to access it in bulk.
• buboard 7y ago
  that sounds bizarre. why would they order them to do that? what if they re trying to block spammers or sth. What about pages that users want public, but not indexable, e.g. dropbox shared links