7 ms·
"the author seems not to have given the slightest thought that he's breaking the site's T&C" LOL! Never read 'em, never going to, couldn't care less about any
by iamnotacrook 7y ago
"the author seems not to have given the slightest thought that he's breaking the site's T&C"
LOL! Never read 'em, never going to, couldn't care less about any of them.
If it was that important they'd make people create and account and sign in and limit access that way. Don't expect people to take all the blah blah blah seriously. It's just a web page.
- bobthepanda 7y agoAnd this is how you get the entire Internet locked behind login pages. Abusing free and open leads to people locking down free and open.
- unityByFreedom 7y agoI'm not sure that's true. Free and open drives more page views and is a more successful marketing strategy where it makes sense.
- sergiotapia 7y agoYeah, I totally agree with you, but also make sure you're not being an asshole with websites and hammer them to the point of bringing them down. Be respectful of their hardware _and_ take the data you need. No need to be burn everything down.
- matz1 7y agoI certainly wouldn't want to burn it down as long as I still need the data, other than that I couldn't care less.
- cgag 7y ago"lol" was my first thought as well, and I suspect many peoples, despite the down votes.
- jrumbut 7y agoFor non-commercial projects I always use at least a one second delay, even for large sites. For commercial projects I have actually advocated to clients that they contact the site's owners and ask to arrange a data use agreement. And a couple have really done it and been satisfied by the result which was cleaner data and continuous updates at a reasonable cost. Seriously, why not? I've never lost anything doing this, you can always scrape (with delay) as Plan B. A little dose of ethics goes a long way!