2 ms·

perhaps the emphasis from companies in the public press is related to product liability laws, consumer protection and being sued? AFAIK the actual research com

perhaps the emphasis from companies in the public press is related to product liability laws, consumer protection and being sued? AFAIK the actual research community in PhD land many times have an internal culture with extreme concern for "harm" from a personal point of view -- it's not fake. If you read the first research papers for various LLM groups, you can see the concern is spelled out in detail, at length. There are high numbers of burnout and psychological issues among practitioners in advanced computer-intensive projects.. so something there seems self-reinforcing, too.

antisthenes 2y ago
> perhaps the emphasis from companies in the public press is related to product liability laws, consumer protection and being sued? It's an interesting thought, but what if the only companies able to run AI platforms are the ones who are able to shoulder the legal cost of all the liabilities it brings? Essentially the legal system resources is the moat for smaller companies here.
- bilbo0s 2y ago
  Just thinking through the liability of tricking an LLM into giving you the personal details of a target. I'm not sure there are many companies out there large enough to shoulder those liabilities? One woman gets killed by some deranged ex, you can get through that. But now you have notice. You know. So you have to do something to make sure your LLM doesn't get tricked again. Politicians and law enforcement aren't going to sit around and let that sort of thing become commonplace. And when politicians get up and start waving around the "crime wave" banner, things can develop in a direction you don't want them to go. So I think it's probably wise for these guys to get out in front of the problem of people tricking LLMs into saying things that they are not intended to say. The option if they can't control that, is that the politicians and law enforcement come in and take advantage of the inevitable nightly news cycle to grab more powers and reelections, and that's not good for anyone in our industry.

antisthenes 2y ago

> perhaps the emphasis from companies in the public press is related to product liability laws, consumer protection and being sued? It's an interesting thought, but what if the only companies able to run AI platforms are the ones who are able to shoulder the legal cost of all the liabilities it brings? Essentially the legal system resources is the moat for smaller companies here.

bilbo0s 2y ago
Just thinking through the liability of tricking an LLM into giving you the personal details of a target. I'm not sure there are many companies out there large enough to shoulder those liabilities? One woman gets killed by some deranged ex, you can get through that. But now you have notice. You know. So you have to do something to make sure your LLM doesn't get tricked again. Politicians and law enforcement aren't going to sit around and let that sort of thing become commonplace. And when politicians get up and start waving around the "crime wave" banner, things can develop in a direction you don't want them to go. So I think it's probably wise for these guys to get out in front of the problem of people tricking LLMs into saying things that they are not intended to say. The option if they can't control that, is that the politicians and law enforcement come in and take advantage of the inevitable nightly news cycle to grab more powers and reelections, and that's not good for anyone in our industry.