3 ms·
It's a relevant question. Regardless of what one thinks about copyright law, it is what it is and all players should abide it. IANAL, so I can't say :( However
by throwaway41597 12y ago
It's a relevant question. Regardless of what one thinks about copyright law, it is what it is and all players should abide it. IANAL, so I can't say :(
However, I think there is a need for a more granular robots.txt such as:
User-agent: *
Allow-crawl: /
Limit-display: /events 10words
Limit-display: /blog 30words
This way, websites can state how big of a search result they are comfortable with and everyone abiding these limits is safer legally. Websites will have to be a bit lenient in order to have prominent results and gain visibility, but they will have to limit that so users click the search result.
Right now, Google has its algorithms decide how much copying is legal and if you disagree you can either disallow Google Bot or sue them, so this would provide a middle ground.