3 ms·
We joke about this now but all it would take is a developer or LLM operator with a dark sense of humor to trigger violent or self harming reactions in people th
by Bender 1y ago
We joke about this now but all it would take is a developer or LLM operator with a dark sense of humor to trigger violent or self harming reactions in people that are already unstable.
- rdtsc 1y agoSycophancy is sort of like that. It seems to cause some people who are probably on the edge or vulnerable to have these mental breakdowns. Here is this cutting edge AI agreeing with every wild idea, telling the person they are a god or everything is just an illusion or simulation etc.
- pjc50 1y agoAI-assisted stochastic terrorism will probably be a very significant problem in the coming years.
- Der_Einzige 1y agoFor this reason if you are an AI researcher/engineer whose done anything interesting or of note, you should expect that the walls are listening/glowing wherever you go.
- ben_w 1y agoSure, but also you should expect that regardless. By the time the UK was voting for the Investigatory Powers Act*, I realised that laser microphones could be mass-produced so cheaply that London's Metropolitan Police could put every window in London under surveillance for less than that police force's normal annual operational budget. And thanks to what Snowden showed, I am distrustful of modern software. And not just closed source stuff, I expect agencies to hire people to attempt to sneak backdoors into OSS, and some of them to even succeed. * https://en.wikipedia.org/wiki/Investigatory_Powers_Act_2016 https://en.wikipedia.org/wiki/Investigatory_Powers_Act_2016
- cheald 1y agoGiving a tool which is specifically good at finding relationships - no matter how strained or tenuous - between arbitrary concepts to paranoid schizophrenics seems like you might as well be lighting the fuse on an unstable bomb.