9 ms·
Current and former AI employees warn of the technology's dangers
- _tk_ 2y agohttps://archive.ph/nnvgy https://archive.ph/nnvgy
- commandlinefan 2y agoSeems like a pretty transparent call for regulatory capture with no specifics.
- moondistance 2y agoThis is the letter: https://righttowarn.ai/ https://righttowarn.ai/
- _tk_ 2y agoSee submission here: https://news.ycombinator.com/item?id=40574351 https://news.ycombinator.com/item?id=40574351
- moondistance 2y agoI'd like to build a chatbot arena with pro-humanity questions.
- deleted 2y ago[deleted]
- dpflan 2y agoRelated: - "OpenAI Insiders Warn of a ‘Reckless’ Race for Dominance " -- https://www.nytimes.com/2024/06/04/technology/openai-culture-whistleblowers.html https://www.nytimes.com/2024/06/04/technology/openai-culture... -- https://news.ycombinator.com/item?id=40574355 https://news.ycombinator.com/item?id=40574355 - "OpenAI Employees Call for Protections to Speak Out on AI Risks " -- https://news.ycombinator.com/item?id=40576018 https://news.ycombinator.com/item?id=40576018
- nilawafer 2y agoWhen China & India form an alliance and send a peace keeping army to protect the former citizens of the fallen American Empire Megacorp, then the American public might have reason to have regrets about AI. But until then it’s just another distraction.
- Slyfox33 2y agoLmao. As if chatbots are going to destroy the world. Give me a break. LLMs, while having some cool uses, are clearly just the next in line of a never ending tech hype scam cycle. Honestly I'm kind of dreading what's coming next because each iteration just gets more insufferable.
- throwup238 2y agoThey might! Imagine if an LLM went full Vogon and attacked us with weapons grade awful poetry. We wouldn’t stand a chance!
- deleted 2y ago[deleted]
- dpflan 2y agoIt's pretty obvious that LLMs can be used to give instructions to machines, those machines could be hooked up to other sensors, like cameras with facial recognition, and actuators. Now imagine a Boston Dynamics DOG robot with a machine gun that can target specific people. This is already possible. If someone were to manufacture and let loose say 100 or 1000 in public, that seems pretty drastic...or flying drones, etc.
- Slyfox33 2y agoLLMs cannot reason so having them control robots wouldn't work. They are reasonably good at text prediction. That's literally all they do.
- 2y ago
- skwirl 2y agoIt’s pretty interesting how widely divergent views of the current state and promise this technology is. The dominant view here on HN seems to be that generative models are overhyped toys that burn massive amounts of energy and investment capital with little signs of promise. Meanwhile you have these AI researchers who are warning about “the loss of control of autonomous AI systems potentially resulting in human extinction.” What are we to make of this?
- lispisok 2y agoResearchers are people too and incentivized to come to conclusions which results in continuing their employment
- 6gvONxR4sf7o 2y agoRemember, "the loss of control of autonomous AI systems potentially resulting in human extinction" is just the very end of the spectrum of risks they're flagging. There are still other very serious risks experts are calling out. I hate for the less controversial risks to get drowned out by arguments over the most controversial ones.
- causal 2y agoCompletely agree, but for that reason also think we need to be more specific when discussing AI safety. Both "AI" and "safety" are overbroad in the extreme.
- rando77 2y agoSome of the AI researchers are probably thinking about future systems only somewhat related to today's systems.
- dpflan 2y agoThe technology is indeed powerful; it's pretty obvious you can make military grade or better propaganda pretty easily with this technology and disseminate it more easily. Let's just classify that as "misinformation" generally, which could also be applied to ideas of teenagers making deepfakes of classmates, etc. So misinformation is a big risk, and already affecting society. It is also clearly useful to whomever is creating the content for whatever their means or ends may be. There are definitely use-cases being worked out for this technology, and the people who are developing these are using this technology on a daily basis (or creating it); their proximity to the technology and gain in understanding of it probably is helping them realize how this could be truly subversive and an existential threat.
- deadbabe 2y agoIsn’t taking risks just a standard part of technological innovation?
- llamaimperative 2y agoSo is mitigating them
- pixl97 2y agoHmm, this is a common line of thought I saw in other young men around me when growing up... [Takes risk]: See I took a risk and nothing happened. [Takes risk]: See I took a risk and nothing happened. [Takes risk]: See I took a risk and nothing happened. [Takes risk]: "Dies horribly and tragically in a completely avoidable fashion after taking excessive risk"
- ein0p 2y agoPeriodic reminder: at the moment, governments worldwide are literally developing killer robots which can’t disobey their orders. Your fears are comically misplaced.
- pixl97 2y agoNo, not misplaced at all, both need monitored and regulated. And large companies like Google and whoever else will gladly sell their model for use in the latest killbot for some of that unlimited military industrial complex money.
- ein0p 2y agoPoint is, people on this very site are cheering on unmanned plane aerobatics while hyperventilating about linear algebra and associative memory which might at times tell you to eat rocks.
- pixl97 2y agoI didn't realize we all represent the exact same things. It's like that sometimes when you forget you're part of the hivemind. Myself, I see a mix of people, some disagreeing with the MIC and others gung ho for the MIC.
- rshah_45 2y agoA heat-seeking missile or nuclear bomb can't disobey orders either. Therefore we should not worry about the dangers of guns or knives.
- ein0p 2y agoHeat seeking missile or a nuclear bomb have to be launched by a human today. Not for much longer though.
- deleted 2y ago[deleted]
- djyaz1200 2y agoWhat are they going to do to harm us, and how are they going to do it? I'm seriously asking.
- ChrisArchitect 2y ago[dupe] https://news.ycombinator.com/item?id=40576018 https://news.ycombinator.com/item?id=40576018
- dmix 2y agoI worry AI safety is going to be a huge political grift soon
- amiantos 2y agoSoon? Seems like we're already there.