3 ms·
that is too restrictive. robots.txt isn't the law.
by spullara 4y ago
that is too restrictive. robots.txt isn't the law.
- michaelmior 4y agoIt's not, but why ignore the express wishes of website owners?
- wahnfrieden 4y agoout of disrespect for IP
- stickfigure 4y agoThe EULA of this HN comment requires you to deposit $2 in my bank account upon reading. Why are you ignoring my wishes?
- jacquesm 4y agoWhat is your bank account?
- michaelmior 4y agoBecause that is a false equivalency. And also, you never responded with your bank info.
- a1369209993 4y agoWhich why they rightly did not say "if and only if".
- jayzalowitz 4y agoI mean sure, but the law of dont be a dick and the world isnt a dick to you applies.