4 ms·

It’s really uncanny how well AI can give out unfounded promises like that the internet will be fixed in 24 hours. I wonder wether there is any legal obligations

It’s really uncanny how well AI can give out unfounded promises like that the internet will be fixed in 24 hours. I wonder wether there is any legal obligations connected to them.

TOMDM 5y ago
Yeah, I've always been impressed with how well GPT3 can give cogent responses, but I've never seen anyone show how to get it to give truthful, informative responses while behaving as a chatbot. Could you feed structured data into the prompt text? like average response rates in the customers area, whether there's capacity to support, the state of engineering teams? Having never seen anyone try it, my gut says it will work reasonably well outside of already known failure modes. (The tendency to loop, make up stories, or joke/cuss people out)
- visarga 5y ago
  Yes, there is a line of research combining passage retrieval with question answering. The query is used to rank passages in a database. The top-k passages are concatenated to the question and used as input by GPT to generate an answer. This means you can keep the model fixed and update the text corpus. Also, you can separate linguistic knowledge from domain knowledge. I think a new type of apps are going to popularise this: a language model + a personal database + web search. It can be used to recall/summarise/search/ information, a general tool for research and cognitive tasks, a GPT-3 Evernote cross breed.
  - deleted 5y ago
    [deleted]
CobrastanJorji 5y ago
That's an absolutely fascinating question. I'm curious about the human equivalent, as well. Say you're talking to a customer service rep for Comcast and they get confused and offer you $10/month cable for life, or maybe they accidentally tell you that you may keep your rental hardware when canceling. Is Comcast in any way bound by what their representatives tell you?
- Kinrany 5y ago
  This is the same problem as with an employee promising something they're not supposed to promise.
  - nostrebored 5y ago
    Except customer support employees are often well trained on what they can say. Eg in Australia not saying ‘best’ in regards to loan products or giving financial advice. The first problem is easy to solve with generated text. The second is much trickier.
    - gjs278 5y ago
      ok but what if one says it? then what?
    - Kinrany 5y ago
      How is training employees different from training an AI intended to replace them?
  - yellow_lead 5y ago
    Right, I've always wondered if this is binding or not. I usually record calls, especially these types of calls, for that reason.
- stubish 5y ago
  The arm chair lawyer in me says probably, but you will need to sue to enforce the breach of contract, so not really. There have been similar cases with enough money at stake for it to get to court, such as the person demanding the jet fighter they were promised as a prize for buying enough Pepsi.
rfrey 5y ago
I suppose they could just say it was the algorithm that made the false claim.

It’s really uncanny how well AI can give out unfounded promises like that the internet will be fixed in 24 hours. I wonder wether there is any legal obligations connected to them.

TOMDM 5y ago

Yeah, I've always been impressed with how well GPT3 can give cogent responses, but I've never seen anyone show how to get it to give truthful, informative responses while behaving as a chatbot. Could you feed structured data into the prompt text? like average response rates in the customers area, whether there's capacity to support, the state of engineering teams? Having never seen anyone try it, my gut says it will work reasonably well outside of already known failure modes. (The tendency to loop, make up stories, or joke/cuss people out)

visarga 5y ago
Yes, there is a line of research combining passage retrieval with question answering. The query is used to rank passages in a database. The top-k passages are concatenated to the question and used as input by GPT to generate an answer. This means you can keep the model fixed and update the text corpus. Also, you can separate linguistic knowledge from domain knowledge. I think a new type of apps are going to popularise this: a language model + a personal database + web search. It can be used to recall/summarise/search/ information, a general tool for research and cognitive tasks, a GPT-3 Evernote cross breed.
- deleted 5y ago
  [deleted]

CobrastanJorji 5y ago

That's an absolutely fascinating question. I'm curious about the human equivalent, as well. Say you're talking to a customer service rep for Comcast and they get confused and offer you $10/month cable for life, or maybe they accidentally tell you that you may keep your rental hardware when canceling. Is Comcast in any way bound by what their representatives tell you?

Kinrany 5y ago
This is the same problem as with an employee promising something they're not supposed to promise.
- nostrebored 5y ago
  Except customer support employees are often well trained on what they can say. Eg in Australia not saying ‘best’ in regards to loan products or giving financial advice. The first problem is easy to solve with generated text. The second is much trickier.
  - gjs278 5y ago
    ok but what if one says it? then what?
  - Kinrany 5y ago
    How is training employees different from training an AI intended to replace them?
- yellow_lead 5y ago
  Right, I've always wondered if this is binding or not. I usually record calls, especially these types of calls, for that reason.
stubish 5y ago
The arm chair lawyer in me says probably, but you will need to sue to enforce the breach of contract, so not really. There have been similar cases with enough money at stake for it to get to court, such as the person demanding the jet fighter they were promised as a prize for buying enough Pepsi.

rfrey 5y ago

I suppose they could just say it was the algorithm that made the false claim.