4 ms·
In this case the less we know, the longer it will last. Notice how this site ignores robots.txt and copyright claims by litigious companies that would like to s
by NavinF 4y ago
In this case the less we know, the longer it will last. Notice how this site ignores robots.txt and copyright claims by litigious companies that would like to see their past erased.
The data saved on your NAS will outlast this site regardless of who owns/funds it.
- fragmede 4y agoHow do you figure?
- NavinF 4y agoWhat do you mean? There’s a line of companies waiting to sue anyone involved with that site. That’s been the case for many years.
- dredmorbius 4y agoA site devoted to duplicating content from elsewhere online, and with a significant use-case of defeating paywalls, would be a very likely candidate for lawsuits. Concealing ownership would tend to help avoid this / minimise consequences. That might still be a brittle defence.
- jonathantf2 4y agoTheir explanation for ignoring robots makes sense - they say they ignore it because their crawler only runs when a human enters a URL and archives it, they also link to Google as this is what they do.