5 ms·
I don't think it's puritan content most people are worried about, it's more about ensuring ChatGPT, etc is not providing leverage to someone who is looking to k
by brentm 3y ago
I don't think it's puritan content most people are worried about, it's more about ensuring ChatGPT, etc is not providing leverage to someone who is looking to kill a lot of people, etc.
- soks86 3y agoI believe there have been at least 2 murder/mass-murder events that are a result of digital companions telling the perpetrator that it's a good idea, they should do it, they will love them (in some cases in the afterlife!). So, yeah. Good concern to have and that is absolutely why.
- Ylpertnodi 3y agoSource(s)?
- welshwelsh 3y agoMaybe, but I think the main impact of these alignment efforts will be to create puritan output.
- Exoristos 3y agoYou can't be serious.
- goatlover 3y agoIsn't that the internet already? So LLMs are trained on a large dataset taken from the public internet, but we (some people) don't like a lot of things on the internet, so we (some people deciding for everyone else) have to make sure it doesn't do anything controversial, unlike the internet.
- yosito 3y agoI don't really think this is a very strong argument for lobotomizing LLMs. Someone with bad intentions can use any technology as a weapon. Just because a knife could cut someone doesn't mean that knives shouldn't be sharp.
- emporas 3y agoI put GPT to write a warning about sharp knives btw. I have posted it on HN some months back, but i can't resist to post it again. About the lobotomy of the models, i think that's a mute point. In my opinion the training methods are going to change a lot over the next 2-3 years, and we will find a way, for a language model, to start in a blank state, not knowing anything about the world, and load up specialized knowledge on demand. I made a separate comment how that can be achieved, a little bit far up. https://imgur.com/a/usrpFc7 https://imgur.com/a/usrpFc7