3 ms·
Utterly predictable. AI will be weaponized and anybody working on it is going to have to live with that knowledge. Consider yourselves part of the MIC from now
by jacquesm 3y ago
Utterly predictable. AI will be weaponized and anybody working on it is going to have to live with that knowledge. Consider yourselves part of the MIC from now on, no more bs about doing this for the betterment of humanity.
And to add to that: once any party figures out how to do this it is a matter of time before the rest does too, there is no such thing as a secret. The atomic bomb leaked and so will the recipe for AGI. So not only are you working for the MIC of your own country you are also enabling your future enemies.
- esafak 3y agoAt least Ilya's crew was working on alignment (https://openai.com/blog/introducing-superalignment https://openai.com/blog/introducing-superalignment). If only the rank-and-file had been more vocally supportive of that, instead of enthusiastically boarding the Altman train. Look where that train is headed...
- throwup238 3y ago> Look where that train is headed... https://en.wikipedia.org/wiki/Metalhead_(Black_Mirror) https://en.wikipedia.org/wiki/Metalhead_(Black_Mirror)
- 8note 3y agoWhat's the benefit of a military ai that's more aligned to the military's goals? If you're against ai military, wouldn't you want the alignment to be poor?
- largbae 3y agoAlignment to _what_? Humans aren't aligned without AI, what exactly will AI be aligned to?
- esafak 3y agoAligned to its creator's specifications. It's value neutral, but constraints are a precondition for avoiding pathological behavior.
- kajecounterhack 3y agoThat's like asking "programs that execute within a predictable scope for what?" For whatever they're being written for. Alignment's goal is to have models to do what they're being trained to do and not other random things. It won't be uniform; for example, determining "what does inappropriate mean" will vary between countries.
- kridsdale1 3y agoSo it sounds like Ilya is making rifles with more precision, then.
- kajecounterhack 3y agoMore like self driving cars that stay within the lines instead of treating everything as an offroad opportunity. If you wanna use rifles from them or mod them to run people over, that's on you right?
- jacquesm 3y agoAlignment with whose values? Altmans? Ilya's? Humanity's? The USA? Some unspecified ideal? I have a really hard time passing the responsibility for such massive impact decisions to a bunch of talented technicians who have already demonstrated a poor command of ethics. The more likely outcome is that it will end up being 'alignment with whoever has the money', and that's a recipe for some bad stuff in our future.
- ChatGTP 3y agoGeoffrey Hinton would love this news. Queue the immortal soldiers?
- kridsdale1 3y agoI put all my hope for humanity in the Open Source AI movement. As a liberal capitalist freedom thinker who likes alt-mags and torrent files. Allowing the AI Ethicists to decide what is and is not aligned is to consign our future to a new dark age of rule by clergy. Just fucking go put on 2112 - Rush already.
- 23B1 3y agoThe people with the most money are the citizens of the United States, to be clear.
- freilanzer 3y agoGood one.
- 23B1 3y agoMy point is that Americans can and will overthrow any regime that makes their lives hard(er). It'll take a LOT to encourage them, but they will do so, and there's even ways to do so peacefully and without violence. Elections, then state laws, then an Article V convention.
- mikrotikker 3y ago
- campl3r 3y agoAs it is happening anyways, I would be happy if the US is at the forefront instead of China or worse.
- jacquesm 3y agoThe US will be at the forefront for just as long as it will take to smuggle a couple of USB sticks out of OpenAI and I figure the chances of Chinese plants at OpenAI to be roughly 100%.
- rvnx 3y agoIt's maybe also that US population tends to underestimate how other people are smart (US-centrism really does exist). Chinese people are very smart, and there is technically more of them, so I am not surprised that they are releasing amazing open models. China has no problems to push their own models for free, and this is a real strategic advantage. These models are aligned with Chinese values, but well, American models are aligned with American beliefs and values as well, right ?
- jacquesm 3y ago> It's maybe also that US population tends to underestimate how other people are smart (US-centrism really does exist). They do. > Chinese people are very smart, and there is technically more of them, so I am not surprised that they are releasing amazing open models. They also have an educational system that wastes less talent and have fewer - if any - roadblocks to the will of the party bosses. In a war a dictatorship can move in ways that a democracy is ill equipped to follow simply because there is no dissent. That's why it took half the world to take on three relatively little countries in WWII. > China has no problems to push their own models for free, and this is a real strategic advantage. It is, but I for one wouldn't use them. > These models are aligned with Chinese values, but well, American models are aligned with American beliefs and values as well, right ? Yes, but I'm far less concerned with the present day models than I am with the advent of AGI which is what OpenAI and various international competitors are aiming for and if one shows it can be done before you can blink this crap will be all over the world. After that point all bets are off.
- hackernewds 3y agoand now you have a system where the nonprofit board (hilarious) is completely incapable of policing the executives, let alone the employees
- BeFlatXIII 3y agoThe perfect career for an accelerationist.
- jacquesm 3y agoWe haven't even properly absorbed the impact of the last two tech revolutions, and the interval between them is shortening. I wasn't/still am not much of a believer in the acceleration scheme but the last two decades and a somewhat serious review of the last 200 years has me wondering if there isn't more to it than it seems.
- kipchak 3y agoIt makes most sense to me if you think of change as a result of people doing things and sharing information and the size of the population. About 7% of the people who ever lived are are alive today. https://info.nicic.gov/ces/global/population-demographics/how-many-people-have-ever-lived-earth https://info.nicic.gov/ces/global/population-demographics/ho...
- BeFlatXIII 3y agoWhat do you define as the "last two tech revolutions"? I don't disagree with you, but I'm curious how far back you're thinking.
- sershe 3y agoAs an immigrant to the USA I'd be really happy to work for MIC without leaving the tech industry (I'm too selfish to accept lower salary + move to the East Coast + deal with, presumably, a huge bureaucracy). Atomic bomb still hasn't leaked beyond ~10% of the countries and many had to do it ~from scratch, so it's not a very good example. The choice with AI is either make one, or wait for it to leak from those who do anyway.
- jacquesm 3y ago> Atomic bomb still hasn't leaked beyond ~10% of the countries and many had to do it ~from scratch, so it's not a very good example. On the contrary, it's a fantastic example because we've been living under the shadow of them ever since they were invented. And long term the chances of them being used again is 100%.
- sershe 3y agoThe GP used it as an example of the technology that would also leak to one's enemies. Atomic bomb is a poor example, it barely leaked and was anyway developed by everybody's enemies. It's better to be the first ones in this case.