4 ms·

Not sure why you’re downvoted. Google certainly did this kind of thing. In the early days there was resistance to web crawling - it’s why robots.txt exists - bu

Not sure why you’re downvoted. Google certainly did this kind of thing. In the early days there was resistance to web crawling - it’s why robots.txt exists - but Google did it anyway. Then they scanned physical books. It was dubious at the time, and I don’t see how it’s different in intent - to monetise it - from what openAI is doing today.

Minor49er 3y ago
Google actually serves up copywritten work directly as part of their results, often to a degree that intercepts traffic that would have made it back to the original source. LLMs at least form a derivative based on a much wider variety of sources rather than just one. Yet nobody bats an eye at Google over this
- supriyo-biswas 3y ago
  The portions of work used by Google (their regular search, and not SGE) are only small snippets and cannot be considered as substitutes for the original work, and Google adds value in the form of a search engine, where quoting some portion of the article is an essential functionality to prove the relevance of the search result. Further, this usage also benefits the author of the article in the form of website visits as the quoted text isn’t a substitute for the article, as mentioned above (and people disagreeing with this, such as news companies, often find out what happens when they lose search traffic due to link tax legislation.) On the other hand, AI models directly derive their value from the training data, and to a large extent, produces works that are a substitute for the original works.
treflop 3y ago
I think your recollection of history is completely off. By the time Google came on the scene, web crawling was well established. AltaVista and Lycos, among others, were already entrenched search engines. robots.txt was created by the guy that created the first search engine.

4 ms·

Not sure why you’re downvoted. Google certainly did this kind of thing. In the early days there was resistance to web crawling - it’s why robots.txt exists - bu

by doctor_eval 3y ago

Minor49er 3y ago
Google actually serves up copywritten work directly as part of their results, often to a degree that intercepts traffic that would have made it back to the original source. LLMs at least form a derivative based on a much wider variety of sources rather than just one. Yet nobody bats an eye at Google over this
- supriyo-biswas 3y ago
  The portions of work used by Google (their regular search, and not SGE) are only small snippets and cannot be considered as substitutes for the original work, and Google adds value in the form of a search engine, where quoting some portion of the article is an essential functionality to prove the relevance of the search result. Further, this usage also benefits the author of the article in the form of website visits as the quoted text isn’t a substitute for the article, as mentioned above (and people disagreeing with this, such as news companies, often find out what happens when they lose search traffic due to link tax legislation.) On the other hand, AI models directly derive their value from the training data, and to a large extent, produces works that are a substitute for the original works.
treflop 3y ago
I think your recollection of history is completely off. By the time Google came on the scene, web crawling was well established. AltaVista and Lycos, among others, were already entrenched search engines. robots.txt was created by the guy that created the first search engine.