8 ms·

1. In your analogy a company is processing resources that humans didn’t create. Dead biomass from ages ago is not a fruit of your work, though note that even th

1. In your analogy a company is processing resources that humans didn’t create. Dead biomass from ages ago is not a fruit of your work, though note that even then you would expect extracting those resources from the ground to be taxed and proceeds to benefit you if you happen to be living on said ground. 2. Unlike petrol vs. raw oil, LLM output is not necessarily “better” than its source material. Indeed there’re plenty of authors that did both extensive work and eloquently written about it, so when LLM is asked a question on the topic their work is among the very few sources—when I am talking about LLM attributing output, I mostly mean instances like these (not when LLM aggregates some really common knowledge). The danger I described is when people are no longer motivated to do such work in the open, assuming it’s then scraped and monetized by LLM operators—or worse, undetectably modified by LLM designers to inject sentiment the original author didn’t subscribe to.

nightski 4y ago
My point is that it's not just a matter of using the source IP directly. A lot of productive work goes into the creation of the model itself. Those weights & biases did not appear on their own. It could not be created without the source IP, but that doesn't mean the source IP is all you need to produce it. You need significant amounts of computing and human resources along with cutting edge research to produce it as well. While the art may be derivative in some cases, the model itself is unique and the value produced by these companies.
- anileated 4y ago
  Transforming oil into petroleum also involves a lot of productive work and it doesn’t go unrewarded and in fact has to be taxed appropriately. But generally in the case I described (topics in which just a few authors did most of the original work) I am not seeing any fundamental benefit if you compare this to a really good search engine—and such a search engine would benefit open information sharing, as it doesn’t do IP laundering.
  - nightski 4y ago
    I guess I don't agree with the assessment that it is a glorified search engine at all. It's a lot more novel than that. I also agree that consent should be received before using an artists images in the training process. That said, if one could compute a training data image's contribution to the end result of a particular query it is entirely possible we could see a portion profits flow back to these artists from the use of their IP in the training process. But at the end of the day, when you train on billions of images, the end profit might be pretty minuscule. Any single artist's contributions might not actually matter all that much in the grand scheme of things. It's the combination of millions of artists that produce a result.
    - anileated 4y ago
      In my previous comment I was focusing on LLMs, per comment I was replying to originally. I gave a visual artwork only as an example, since it’s not quite possible with textual information. With text what we may observe is just less of it being published, and it’s difficult to use an absence of something as an illustration. Though in recent years more people began catching on that leaving a good review might ruin a place for them, the evidence of that isn’t obvious (it’s just fewer reviews or less good-faith reviews). Similar results but on larger scale may be observed as people are catching on that writing they publish in the open is essentially feeding a magic answering box monetised by someone else.

nightski 4y ago

My point is that it's not just a matter of using the source IP directly. A lot of productive work goes into the creation of the model itself. Those weights & biases did not appear on their own. It could not be created without the source IP, but that doesn't mean the source IP is all you need to produce it. You need significant amounts of computing and human resources along with cutting edge research to produce it as well. While the art may be derivative in some cases, the model itself is unique and the value produced by these companies.

anileated 4y ago
Transforming oil into petroleum also involves a lot of productive work and it doesn’t go unrewarded and in fact has to be taxed appropriately. But generally in the case I described (topics in which just a few authors did most of the original work) I am not seeing any fundamental benefit if you compare this to a really good search engine—and such a search engine would benefit open information sharing, as it doesn’t do IP laundering.
- nightski 4y ago
  I guess I don't agree with the assessment that it is a glorified search engine at all. It's a lot more novel than that. I also agree that consent should be received before using an artists images in the training process. That said, if one could compute a training data image's contribution to the end result of a particular query it is entirely possible we could see a portion profits flow back to these artists from the use of their IP in the training process. But at the end of the day, when you train on billions of images, the end profit might be pretty minuscule. Any single artist's contributions might not actually matter all that much in the grand scheme of things. It's the combination of millions of artists that produce a result.
  - anileated 4y ago
    In my previous comment I was focusing on LLMs, per comment I was replying to originally. I gave a visual artwork only as an example, since it’s not quite possible with textual information. With text what we may observe is just less of it being published, and it’s difficult to use an absence of something as an illustration. Though in recent years more people began catching on that leaving a good review might ruin a place for them, the evidence of that isn’t obvious (it’s just fewer reviews or less good-faith reviews). Similar results but on larger scale may be observed as people are catching on that writing they publish in the open is essentially feeding a magic answering box monetised by someone else.