3 ms·

> From my point of view, it is sad that these sort of socio-political constructs (copyright) are hindering innovation Why not pay authors of the data the LLM h

> From my point of view, it is sad that these sort of socio-political constructs (copyright) are hindering innovation Why not pay authors of the data the LLM has ingested?

SirMaster 3y ago
Don't a lot of content creators expect payment per use? Like every time someone streams a song on sportify, the artist gets a few pennies. So should they be paid a few pennies every time the LLM spits out a response that "used" that training data? And I am pretty sure it's not even possible to really link the output back to training data anyways.
- robterrell 3y ago
  > Like every time someone streams a song on sportify, the artist gets a few pennies You're thinking of broadcast radio. Streaming is a fraction of a penny! > So should they be paid a few pennies every time the LLM spits out a response that "used" that training data? That doesn't sound unreasonable! I understand that current LLMs have no way to report "this token came from this data" but that doesn't mean it's impossible to build. (Ack: this is a full-on proper dunning-kruger, having not looked into it & having zero knowledge of the field.) But I think it's probably more reasonable to simply split a % of the service revenue across everyone whose data was used. Or pay an up-fee for ingesting the data in the first place. Generally, it's crazy to name that some people think it's reasonable for these companies to pay for GPUs and CPUs and electricity to run them but not for the data that's the actual core of their service.
epups 3y ago
Since they are trained on all kinds of Internet content, might be a little tricky to manage paying >1B people
- robterrell 3y ago
  I mean, figure something out? Didn't Sam want to create UBI? That's one way!
- ChatGTP 3y ago
  I'm sure it would be easy to pay publishers who pass on the money? How do you think Amazon does things for kindle?
  - epups 3y ago
    Will you get a check for your posts on HN? Your tweets? No, right? So all this talk about paying people for their data is rubbish, and what is really at stake here are checks between huge corporations that already stole it from you in the first place.
    - ChatGTP 3y ago
      I'm not quite sure which side your on but yeah, I personally have stopped participating in social media since realizing I'm the product. HN I agree with you, but I feel like I'm getting enough back from this community to make my time worth it.

> From my point of view, it is sad that these sort of socio-political constructs (copyright) are hindering innovation Why not pay authors of the data the LLM has ingested?

SirMaster 3y ago

Don't a lot of content creators expect payment per use? Like every time someone streams a song on sportify, the artist gets a few pennies. So should they be paid a few pennies every time the LLM spits out a response that "used" that training data? And I am pretty sure it's not even possible to really link the output back to training data anyways.

robterrell 3y ago
> Like every time someone streams a song on sportify, the artist gets a few pennies You're thinking of broadcast radio. Streaming is a fraction of a penny! > So should they be paid a few pennies every time the LLM spits out a response that "used" that training data? That doesn't sound unreasonable! I understand that current LLMs have no way to report "this token came from this data" but that doesn't mean it's impossible to build. (Ack: this is a full-on proper dunning-kruger, having not looked into it & having zero knowledge of the field.) But I think it's probably more reasonable to simply split a % of the service revenue across everyone whose data was used. Or pay an up-fee for ingesting the data in the first place. Generally, it's crazy to name that some people think it's reasonable for these companies to pay for GPUs and CPUs and electricity to run them but not for the data that's the actual core of their service.

epups 3y ago

Since they are trained on all kinds of Internet content, might be a little tricky to manage paying >1B people

robterrell 3y ago
I mean, figure something out? Didn't Sam want to create UBI? That's one way!
ChatGTP 3y ago
I'm sure it would be easy to pay publishers who pass on the money? How do you think Amazon does things for kindle?
- epups 3y ago
  Will you get a check for your posts on HN? Your tweets? No, right? So all this talk about paying people for their data is rubbish, and what is really at stake here are checks between huge corporations that already stole it from you in the first place.
  - ChatGTP 3y ago
    I'm not quite sure which side your on but yeah, I personally have stopped participating in social media since realizing I'm the product. HN I agree with you, but I feel like I'm getting enough back from this community to make my time worth it.