3 ms·
I don't see what the relationship should really be with robots.txt. Block their site will not make them profitable, it doesn't provide a source of revenue.
by igrekel 17y ago
I don't see what the relationship should really be with robots.txt. Block their site will not make them profitable, it doesn't provide a source of revenue.
- jpwatts 17y agoThey claim to be generating the revenue, only to have it stolen by Google and others. If this was the case, /robots.txt could go a long way towards preventing billions of dollars from "leak[ing] onto the Internet" each year.
- igrekel 17y agoI had a different understanding of what the core point was, the google part felt more like a sub point. My understanding was that since the content is freely accessible on the internet, people don't need to subscribe to newspapers, and that online advertising can't cover for the difference.