3 ms·

What problem do you think a licensing tag would solve? > How should a crawler know, if it may or may not take some random text from a website and display it so

What problem do you think a licensing tag would solve? > How should a crawler know, if it may or may not take some random text from a website and display it somewhere else? The recommendation I follow is to use robots.txt to disable crawling of specific pages or paths. If I really want information protected I either (a) put it behind authentication or (b) don't put it on a public website. > How can it know, who to credit, or whether to credit someone at all? Why does the content need credit at the search engine level? If the reader cares, the reader will navigate to the page and determine the author.

DarkWiiPlayer 8y ago
> What problem do you think a licensing tag would solve? Crawlers could, with more granularity, decide what they may embed and how. > Why does the content need credit at the search engine level? It's not just about search engines though. > The recommendation I follow is to use robots.txt to disable crawling of specific pages or paths. Thay way you're just locking bots out. It's a completely different thing. This is not about protection; it's about communication. > If I really want information protected I either (a) put it behind authentication or (b) don't put it on a public website. If you want to avoid people stealing things they shouldn't, yeah, that's your only option. If all you want is to communicate whether or not they may take your content, you don't really have any tools to do so. Again: Communication; not protection. > If the reader cares, the reader will navigate to the page and determine the author. No. That's not how it works. You can't expect users to click through several links to find the author of a resource. Unless you link directly to the resource on the authors site, the author should in many cases be credited directly next to where the resource is embedded.

DarkWiiPlayer 8y ago

> What problem do you think a licensing tag would solve? Crawlers could, with more granularity, decide what they may embed and how. > Why does the content need credit at the search engine level? It's not just about search engines though. > The recommendation I follow is to use robots.txt to disable crawling of specific pages or paths. Thay way you're just locking bots out. It's a completely different thing. This is not about protection; it's about communication. > If I really want information protected I either (a) put it behind authentication or (b) don't put it on a public website. If you want to avoid people stealing things they shouldn't, yeah, that's your only option. If all you want is to communicate whether or not they may take your content, you don't really have any tools to do so. Again: Communication; not protection. > If the reader cares, the reader will navigate to the page and determine the author. No. That's not how it works. You can't expect users to click through several links to find the author of a resource. Unless you link directly to the resource on the authors site, the author should in many cases be credited directly next to where the resource is embedded.