8 ms·

White House Secures Commitments from Leading AI Companies to Manage AI Risks

61 points by apsec112 3y ago

asimpleusecase 3y ago
Looks like the companies all agreed to do what they were doing already. Nothing about training data transparency , nothing about a common definition of risk or standards for compliance. The public have all heard “AI is going to destroy humanity” but those statements have been short on specifics. I have been asked by many people to explain how AI could kill us all. How about some clarity for common people.
- ilaksh 3y ago
  People always say "AGI" and they mean different things but I am guessing most now mean something like a digital living human/simulation of human when they say that. Mixed in with some blurry connotation of it automatically becoming godlike in power. That stuff is very speculative. But we don't need AI to get to that level for it to be very dangerous. Just imagine that we have an open source GPT that is something like 33% smarter than GPT-4 and less brittle. Make the output 50 times faster than human thought and suppose that we can run it very inexpensively, in a "swarm" of agents cooperating. Then you have a type of superintelligence that does not require any really speculative AI advance -- hyperspeed reasoning -- based on the current technology. If that is widely deployed for military and industrial decision-making then something like a computer virus could create existential risk. Also, realize that all these systems really need to emulate some of the core functional aspects of animals, like a self-preservation instinct or desire to control resources, is the right instruction and relaxation of guardrails. So when they can reason a bit better and at hyperspeed with collaboration between them, they don't need to be alive or anything to be dangerous. Look at the history of increases in computing efficiency. It is easy to imagine 50 or whatever times output speed increase in less than 5 years. And even though they are not human level now, GPT-4 has proven that these types of systems can have strong problem solving ability. One more thing to add is that as the AI performance increases and surpasses human decision-making ability, the hyperspeed will push competiting companies and countries to give them broader and broader goals and more autonomy. Because waiting overnight for human input means your competitor's AIs race ahead the equivalent of weeks. I think we need to set a limit for the performance of new hardware at some point. Also we need people to understand the dangers of full autonomy and imitating animals in the context of hyperspeed or superintelligent AI. We will need criminal penalties and maybe some type of cooperative digital immune system.
  - LatteLazy 3y ago
    I think you also need to draw a line between different types of danger: An actual AGI, that can think and has it's own motives and initiative is an entirely different danger to GPT-4, -5 etc which cannot. Those might post a danger in terms of fake news, or worker displacement, but they're just social issues. No rate improvement in chat GPT will make it "decide to kill all the humans" etc.
    - Dalewyn 3y ago
      Every time I hear how artificial intelligence with its "own motives" etc. are dangerous, I wonder how it's different from just dealing with people and animals. Or to put it another way, I can't see how artificial intelligence could be any more dangerous than intelligence as we already know and have them.
      - jonplackett 3y ago
        I think that’s the problem isn’t it? Intelligence has proven to be exceptionally dangerous!
      - LatteLazy 3y ago
        I don't want to sound dismissive but... Well yeah. We already know humans are dangerous. And that is humans who are conditioned to be social, and who have empathy and who rely on other humans for all sorts of things. Plus with fear of a legal system punishing them. Now imagine a human like intelligence without empathy, that is not conditioned from childhood to be social, and that is inherently threatened by us and not reliant on us. Would you want that guy living next door? Oh and it's 100x smarter than you. I think all this is 100 years away, but that's the theory. Skynet doesn't have a subconscious telling it not to murder it's parents...
      - robnado 3y ago
        How dangerous can a dictator with complete knowledge and super human speed actually be?
      - Jagah 3y ago
- localplume 3y ago
  if you think about it, its actual insanity. The fears are all from science fiction with absolutely no grounding in reality. There are legitimate concerns about the unethical mass harvesting of data but if you think about "AI safety" vs something like vehicular safety or spacecraft safety its kind of nuts, because the latter are grounded in reality and have formal specifications which need to be met. But AI safety is so wishy-washy. Take a look at https://en.wikipedia.org/wiki/Federal_Motor_Vehicle_Safety_Standards https://en.wikipedia.org/wiki/Federal_Motor_Vehicle_Safety_S... You'd think if people are so scared about AI being apocalyptic it would have some strict regulation similar to vehicle standards but its not even close, nor is it in the conversation at all. Its just pure fear from science fiction and the govt putting out performative press releases. What the fuck even is "AI" anyway? it means different things to different people. It could mean a self checkout at a supermarket, or a bank's AML, or some super intelligence. there are basically no standard definitions of anything to do with "AI" anywhere and every single piece of regulation is equally as vague. Companies like having it be a vague term because its marketing so the actual experts don't care about changing it
  - ke88y 3y ago
    > What the fuck even is "AI" anyway? Indeed. For most lay people I've talked to -- family, friends, and acquiescence outside of tech -- the answer ultimately boils down to "automation that can do my job or can do the job of people I care about or can do the job of people who would then compete for my job". Sometimes also "algorithms" a la social media feeds and so on. Ie, the lay answer to "what is AI?" has recently morphed into roughly "computer programs that I am worried about or don't like". For most actual AI researchers I've talked to, you get the standard tounge-in-cheek response ("AI is whatever gets published at AI conferences and funded by AI investors") and then, when you press, it's roughly something like ML+CV+NLP+optimization and sometimes but not always other fields like automated reasoning or parts of robotics get added. Roughly, most of the parts of CS that aren't theory or systems or HCI or software engineering or already closed. For most techno-babblers in the podosphere who have OPINIONS on super-intelligence but couldn't pass an internship phone screen to save their lives, it's superintelligence and other stupid hollywood bullshit.
- gsatic 3y ago
  That's cuz Theory of Bounded Rationality applies. When we are passed the point where ppl with their 3 inch brains can actually come up with answers to complex problems, you don't spend time asking them questions.
- adamsmith143 3y ago
  >I have been asked by many people to explain how AI could kill us all. How about some clarity for common people. There are countless resources to find this stuff out. To be clear there may not be a level at which common people understand why e.g. Fission Chain Reactions are dangerous but they can grok why a giant bomb that spreads radiation is bad. For Starters: https://www.lesswrong.com/posts/uMQ3cqWDPHhjtiesc/agi-ruin-a-list-of-lethalities https://www.lesswrong.com/posts/uMQ3cqWDPHhjtiesc/agi-ruin-a... >The public have all heard “AI is going to destroy humanity” but those statements have been short on specifics. You can no more explain how Stockfish is going to beat you at chess then you can predict how an AGI would defeat humanity. Nevertheless the outcome is nearly certain.
  - deleted 3y ago
    [deleted]
  - jazzyjackson 3y ago
    You have to find a different preacher than Yud, he has zero capacity to explain himself to skeptics.
    - lukifer 3y ago
      Robert Miles is a much more effective communicator: https://www.youtube.com/watch?v=kMLKbhY0ji0 https://www.youtube.com/watch?v=kMLKbhY0ji0
      - jazzyjackson 3y ago
        Thanks, I'm a half hour in and will keep listening; he's more soft spoken and relatable sure but he still strikes me as a vague doomer who's not trying to explain why he's confident humans will lose, just that he's confident. @30:24, on what solutions might be realistic to help, if not a 6 month sanction, Miles says: "Maybe what we should be asking for is just an enormous amount of money to do alignment research with" Sounds like a classic doomsday cult, end is nigh, deposit your checks to this account...
- WalterBright 3y ago
  > I have been asked by many people to explain how AI could kill us all. "Colossus The Forbin Project", "Terminator" I.e. giving control of weapons to an AI.
- roenxi 3y ago
  It is likely to be similar to humans vs. other primates. Step 1 is establish a position of complete military dominance through superior communication, resource utilisation and technology. Step 2 is wipe out anyone who competes for resources. Basically the argument is if anyone, anywhere creates an AI that has the same basic drives as a human (preserve yourself, replicate, preserve things that look like you) it'll start competing with us for resources. AIs have demonstrated the ability to crush humans at every competitive game we can play with them, so they'll crush us at that game too. It looks a bit far fetched in 2023 but it is actually pretty easy to see it happening. Hardware progresses exponentially for a few more years. Some war-torn state gets desperate, starts deploying military AIs to try and get an edge, loses control, yada yada. Or economic pressure starts engineering humans out of the loop in one too many places and evolutionary pressures happen by accident to develop an intelligent autonomous agent that wants to replicate. Humans struggled with a cold virus recently and couldn't stamp it out. Something that can outdo us research-wise would not be something we can handle. Whether humanity has control of corporations is an open question given the number of people who get killed if it is profitable to do so. We've been luck that corporations need people to act as a brain. AIs don't need that.
  - hgsgm 3y ago
    AI is really bad at plugging itself in after it is unplugged.
    - roenxi 3y ago
      That is like a gorilla grunting that humans are weak and will die after it hits us with its fist. Which is to say, that is completely true. But if you're up against an opponent who is smarter than you it might never come down to a fistfight. Every big gorilla on the planet could kill me. None of them can outcompete me for something, because I'm not stupid enough to challenge a big gorilla to a fistfight. There won't be a fight until after I've got my hands on a gun and the gorilla is an easy shot. There probably won't need to be a fight because I'll just trade for what I want using tactics that a gorilla cannot comprehend the effectiveness of. There is a pretty good chance humans won't even realise they are competing with an AI until they are locked out from having options. I'm not even sure if most gorillas realise to this day that we humans will crush them if they ever try anything that threatens us.
- tivert 3y ago
  > The public have all heard “AI is going to destroy humanity” but those statements have been short on specifics. Honestly, my understanding is that's mainly a distraction from the much more realistic: > AI is going to take your job and impoverish your family while making the rich even richer. But cheer up! You'll be able to talk to a chatbot therapist about your problems, from your cardboard home under a bridge, so it's progress! In the past, not even kings had chatbot therapists! You'll have it better than a king!
  - hanselot 3y ago
    I'm sorry, but as an AI language model, I am not qualified to give you advice on how to improve the build structure of your cardboard home. I advise you to speak to a qualified professional cardboardpenter or simply to go stand in the begging que in front of our headquarters in San Francisco. Feel free to take your home with you, given how long the line is.
LatteLazy 3y ago
No bonding, undefined, unmeasurable "commitments"...
guerrilla 3y ago
I feel like this is one of those things that belongs in those news clips you see at the beginning of a dystopian or post-apocalyptic sci-fi film. It's just vague PR that won't actually do anything of substance.
- jonplackett 3y ago
  Peace in our time is guaranteed. Neville Chamberlain would be proud
unixhero 3y ago
We need libre and open source to move faster.
- guerrilla 3y ago
  How? Where can we donate? What can we do?
DebtDeflation 3y ago
[flagged]
- teeray 3y ago
  It makes more sense when you realize AI Safety is about the safety of the companies making AI from competitors.
- adolph 3y ago
  Do you have a better physical world analogy than a "series of tubes" to describe bandwidth and latency? https://www.pcmag.com/news/a-remembrance-and-defense-of-ted-stevens-series-of-tubes https://www.pcmag.com/news/a-remembrance-and-defense-of-ted-... Comment in context: "They want to deliver vast amounts of information over the Internet. And again, the Internet is not something that you just dump something on. It's not a big truck. It's a series of tubes. And if you don't understand, those tubes can be filled and if they are filled, when you put your message in, it gets in line and it's going to be delayed by anyone that puts into that tube enormous amounts of material, enormous amounts of material." https://en.wikipedia.org/wiki/Series_of_tubes https://en.wikipedia.org/wiki/Series_of_tubes
blitzar 3y ago
Team America: World Police (2004) Lisa: Promise me you'll never die. Gary Johnston: You know I can't promise that. Lisa: If you did that, I would make love to you right now Gary Johnston: I promise I'll never die. https://www.youtube.com/watch?v=aplSQGHPmvI https://www.youtube.com/watch?v=aplSQGHPmvI Lisa Secures Commitments from Gary to Never Die.
throwaway72762 3y ago
This strikes me as the best outcome as long as it stops here. This lets the White House move on from the nonsense AI x-risk discussion without being attacked for not doing anything about it, and also doesn't let the companies use fake x-risk to kill off open source models.
- freedomben 3y ago
  I agree with you, but it isn't going to stop here: > Biden-Harris Administration will continue to take decisive action by developing an Executive Order and pursuing bipartisan legislation to keep Americans safe
  - javier123454321 3y ago
    Ah the lengths they will go for our safety.
- malfist 3y ago
  Yes, let's hope it stops here. I have full faith in billionaires looking out for our best interests as a society
- kalkin 3y ago
  I'm a cynic but even so I've been surprised by how the tone of confident dismissal of x-risk as "nonsense" has been completely unaffected by the change in messenger from LW weirdos to Turning Award winners. Like people don't even feel the need to gesture at an argument, it's just supposed to be obvious. What's really going on is good open source vs evil corporate control, a lot of commenters are sure, and the government is just out-of-touch geriatric puppets—even as the "open source vs Micro$oft" narrative has been ported straight from the 90s to a world where the concrete policy question is "should Meta bear any responsibility for the consequences of their software releases."
  - throwaway72762 3y ago
    Why should the tone have changed? The billionaires and AI godfathers talking about it now all were inspired by LW and scifi, and it's the same narrative: no need to care about people living today or real problems in the world when there's a scifi story about trillions of people in the future for whom we must sacrifice anything (except the billionaires and AI godfathers comfort, status, or money) in the present to protect.
kevinventullo 3y ago
Kind of like how the White House secured commitments from banks to manage systemic financial risks?
- kevmo 3y ago
  Another fine case of regulatory capture! https://en.wikipedia.org/wiki/Regulatory_capture https://en.wikipedia.org/wiki/Regulatory_capture
- codyb 3y ago
  The big banks were pretty stable in this last go around, and systemically it never really felt like there was much risk? So maybe some things are working?
josh_today 3y ago
[dead]
Imnimo 3y ago
>The companies commit to developing robust technical mechanisms to ensure that users know when content is AI generated, such as a watermarking system. I've seen some papers on watermarking, but none of them are what I'd call "robust" - they're easily defeated by making small changes to the data. Are the companies "committing" to overcome an unsolved (and possibly unsolvable) technical challenge?
zer0c00ler 3y ago
Companies commit to testing systems - well, what about the commitment to actual fix problems? Would have been nice to see that. Even right now there are known security vulnerabilities that were found through testing but haven’t been fixed.
option 3y ago
Harris is our AI “czar”. She is known to be generally “not the brightest person”. Which experiences/competence makes her AI czar? Imagine someone like that having a say on how country develops nuclear at the end of ww2.
classified 3y ago
Making the wolf the shepherd. What could possibly go wrong.
airstrike 3y ago
This reeks of ass-covering so we everyone can later say "We are sorry. We tried." followed by some more innocuous PR lingo Great for voters to sleep better at night. Useless for actually "managing AI risks" Not that those risks can seriously be managed long-term, IMHO. The prisoner's dilemma between nation states and corporations ensures someone will defect.
- ilaksh 3y ago
  Right. Check out the new Netflix documentary "Unknown: Killer Drones". Basically former soldiers running military tech companies with the experience of losing their friends in battle are looking at how DeepMind's AIs are undefeatable at Star Craft II, Go, and pretty much every game they train it for. And already testing plugging that type of thing into drones and jets. And now DeepMind wants to combine the language-based fairly general purpose reasoning ability of something like GPT with the superhuman strategic prowess of AlphaStar/AlphaZero/etc. At the latest big keynote Nvidia touted the fact that they have accelerated AI by a factor of one million over the last decade, and project that they will do so again in the next decade. Humans will not be able to compete at all, and even putting them in the decision loop will mean immediate failure. Human thought and action will "appear" to be so slow that it is essentially frozen compared to the operating speed of these systems.
codyb 3y ago
This actually seems semi decent for a first go? 140 million in funding for seven more research labs (might be a different order but still neat). Commitments for cybersecurity funding (probably already happening anyways), independent auditing, and some testing. The most interesting part was the watermarking. I'm interested to see how that works out, but it's a neat concept, something I hadn't thought of. I like the focus on reducing bias, that seems like a good effort and of course the focus on helping to cure cancer which I'm always a fan of Biden being such a champion of. Also reaching out to key allies to work together seems positive. I dunno, all in all, it seems kind of neat. Call me a wild eyed optimist or something.
frankfrankfrank 3y ago
[dead]
tastyfreeze 3y ago
Call me cynical but its hard to see this as anything but a way to create a moat for the incumbent leaders in the field.

61 points by apsec112 3y ago

Looks like the companies all agreed to do what they were doing already. Nothing about training data transparency , nothing about a common definition of risk or standards for compliance. The public have all heard “AI is going to destroy humanity” but those statements have been short on specifics. I have been asked by many people to explain how AI could kill us all. How about some clarity for common people.

ilaksh 3y ago
People always say "AGI" and they mean different things but I am guessing most now mean something like a digital living human/simulation of human when they say that. Mixed in with some blurry connotation of it automatically becoming godlike in power. That stuff is very speculative. But we don't need AI to get to that level for it to be very dangerous. Just imagine that we have an open source GPT that is something like 33% smarter than GPT-4 and less brittle. Make the output 50 times faster than human thought and suppose that we can run it very inexpensively, in a "swarm" of agents cooperating. Then you have a type of superintelligence that does not require any really speculative AI advance -- hyperspeed reasoning -- based on the current technology. If that is widely deployed for military and industrial decision-making then something like a computer virus could create existential risk. Also, realize that all these systems really need to emulate some of the core functional aspects of animals, like a self-preservation instinct or desire to control resources, is the right instruction and relaxation of guardrails. So when they can reason a bit better and at hyperspeed with collaboration between them, they don't need to be alive or anything to be dangerous. Look at the history of increases in computing efficiency. It is easy to imagine 50 or whatever times output speed increase in less than 5 years. And even though they are not human level now, GPT-4 has proven that these types of systems can have strong problem solving ability. One more thing to add is that as the AI performance increases and surpasses human decision-making ability, the hyperspeed will push competiting companies and countries to give them broader and broader goals and more autonomy. Because waiting overnight for human input means your competitor's AIs race ahead the equivalent of weeks. I think we need to set a limit for the performance of new hardware at some point. Also we need people to understand the dangers of full autonomy and imitating animals in the context of hyperspeed or superintelligent AI. We will need criminal penalties and maybe some type of cooperative digital immune system.
- LatteLazy 3y ago
  I think you also need to draw a line between different types of danger: An actual AGI, that can think and has it's own motives and initiative is an entirely different danger to GPT-4, -5 etc which cannot. Those might post a danger in terms of fake news, or worker displacement, but they're just social issues. No rate improvement in chat GPT will make it "decide to kill all the humans" etc.
  - Dalewyn 3y ago
    Every time I hear how artificial intelligence with its "own motives" etc. are dangerous, I wonder how it's different from just dealing with people and animals. Or to put it another way, I can't see how artificial intelligence could be any more dangerous than intelligence as we already know and have them.
    - jonplackett 3y ago
      I think that’s the problem isn’t it? Intelligence has proven to be exceptionally dangerous!
    - LatteLazy 3y ago
      I don't want to sound dismissive but... Well yeah. We already know humans are dangerous. And that is humans who are conditioned to be social, and who have empathy and who rely on other humans for all sorts of things. Plus with fear of a legal system punishing them. Now imagine a human like intelligence without empathy, that is not conditioned from childhood to be social, and that is inherently threatened by us and not reliant on us. Would you want that guy living next door? Oh and it's 100x smarter than you. I think all this is 100 years away, but that's the theory. Skynet doesn't have a subconscious telling it not to murder it's parents...
    - robnado 3y ago
      How dangerous can a dictator with complete knowledge and super human speed actually be?
    - Jagah 3y ago
localplume 3y ago
if you think about it, its actual insanity. The fears are all from science fiction with absolutely no grounding in reality. There are legitimate concerns about the unethical mass harvesting of data but if you think about "AI safety" vs something like vehicular safety or spacecraft safety its kind of nuts, because the latter are grounded in reality and have formal specifications which need to be met. But AI safety is so wishy-washy. Take a look at https://en.wikipedia.org/wiki/Federal_Motor_Vehicle_Safety_Standards https://en.wikipedia.org/wiki/Federal_Motor_Vehicle_Safety_S... You'd think if people are so scared about AI being apocalyptic it would have some strict regulation similar to vehicle standards but its not even close, nor is it in the conversation at all. Its just pure fear from science fiction and the govt putting out performative press releases. What the fuck even is "AI" anyway? it means different things to different people. It could mean a self checkout at a supermarket, or a bank's AML, or some super intelligence. there are basically no standard definitions of anything to do with "AI" anywhere and every single piece of regulation is equally as vague. Companies like having it be a vague term because its marketing so the actual experts don't care about changing it
- ke88y 3y ago
  > What the fuck even is "AI" anyway? Indeed. For most lay people I've talked to -- family, friends, and acquiescence outside of tech -- the answer ultimately boils down to "automation that can do my job or can do the job of people I care about or can do the job of people who would then compete for my job". Sometimes also "algorithms" a la social media feeds and so on. Ie, the lay answer to "what is AI?" has recently morphed into roughly "computer programs that I am worried about or don't like". For most actual AI researchers I've talked to, you get the standard tounge-in-cheek response ("AI is whatever gets published at AI conferences and funded by AI investors") and then, when you press, it's roughly something like ML+CV+NLP+optimization and sometimes but not always other fields like automated reasoning or parts of robotics get added. Roughly, most of the parts of CS that aren't theory or systems or HCI or software engineering or already closed. For most techno-babblers in the podosphere who have OPINIONS on super-intelligence but couldn't pass an internship phone screen to save their lives, it's superintelligence and other stupid hollywood bullshit.
gsatic 3y ago
That's cuz Theory of Bounded Rationality applies. When we are passed the point where ppl with their 3 inch brains can actually come up with answers to complex problems, you don't spend time asking them questions.
adamsmith143 3y ago
>I have been asked by many people to explain how AI could kill us all. How about some clarity for common people. There are countless resources to find this stuff out. To be clear there may not be a level at which common people understand why e.g. Fission Chain Reactions are dangerous but they can grok why a giant bomb that spreads radiation is bad. For Starters: https://www.lesswrong.com/posts/uMQ3cqWDPHhjtiesc/agi-ruin-a-list-of-lethalities https://www.lesswrong.com/posts/uMQ3cqWDPHhjtiesc/agi-ruin-a... >The public have all heard “AI is going to destroy humanity” but those statements have been short on specifics. You can no more explain how Stockfish is going to beat you at chess then you can predict how an AGI would defeat humanity. Nevertheless the outcome is nearly certain.
- deleted 3y ago
  [deleted]
- jazzyjackson 3y ago
  You have to find a different preacher than Yud, he has zero capacity to explain himself to skeptics.
  - lukifer 3y ago
    Robert Miles is a much more effective communicator: https://www.youtube.com/watch?v=kMLKbhY0ji0 https://www.youtube.com/watch?v=kMLKbhY0ji0
    - jazzyjackson 3y ago
      Thanks, I'm a half hour in and will keep listening; he's more soft spoken and relatable sure but he still strikes me as a vague doomer who's not trying to explain why he's confident humans will lose, just that he's confident. @30:24, on what solutions might be realistic to help, if not a 6 month sanction, Miles says: "Maybe what we should be asking for is just an enormous amount of money to do alignment research with" Sounds like a classic doomsday cult, end is nigh, deposit your checks to this account...
WalterBright 3y ago
> I have been asked by many people to explain how AI could kill us all. "Colossus The Forbin Project", "Terminator" I.e. giving control of weapons to an AI.
roenxi 3y ago
It is likely to be similar to humans vs. other primates. Step 1 is establish a position of complete military dominance through superior communication, resource utilisation and technology. Step 2 is wipe out anyone who competes for resources. Basically the argument is if anyone, anywhere creates an AI that has the same basic drives as a human (preserve yourself, replicate, preserve things that look like you) it'll start competing with us for resources. AIs have demonstrated the ability to crush humans at every competitive game we can play with them, so they'll crush us at that game too. It looks a bit far fetched in 2023 but it is actually pretty easy to see it happening. Hardware progresses exponentially for a few more years. Some war-torn state gets desperate, starts deploying military AIs to try and get an edge, loses control, yada yada. Or economic pressure starts engineering humans out of the loop in one too many places and evolutionary pressures happen by accident to develop an intelligent autonomous agent that wants to replicate. Humans struggled with a cold virus recently and couldn't stamp it out. Something that can outdo us research-wise would not be something we can handle. Whether humanity has control of corporations is an open question given the number of people who get killed if it is profitable to do so. We've been luck that corporations need people to act as a brain. AIs don't need that.
- hgsgm 3y ago
  AI is really bad at plugging itself in after it is unplugged.
  - roenxi 3y ago
    That is like a gorilla grunting that humans are weak and will die after it hits us with its fist. Which is to say, that is completely true. But if you're up against an opponent who is smarter than you it might never come down to a fistfight. Every big gorilla on the planet could kill me. None of them can outcompete me for something, because I'm not stupid enough to challenge a big gorilla to a fistfight. There won't be a fight until after I've got my hands on a gun and the gorilla is an easy shot. There probably won't need to be a fight because I'll just trade for what I want using tactics that a gorilla cannot comprehend the effectiveness of. There is a pretty good chance humans won't even realise they are competing with an AI until they are locked out from having options. I'm not even sure if most gorillas realise to this day that we humans will crush them if they ever try anything that threatens us.
tivert 3y ago
> The public have all heard “AI is going to destroy humanity” but those statements have been short on specifics. Honestly, my understanding is that's mainly a distraction from the much more realistic: > AI is going to take your job and impoverish your family while making the rich even richer. But cheer up! You'll be able to talk to a chatbot therapist about your problems, from your cardboard home under a bridge, so it's progress! In the past, not even kings had chatbot therapists! You'll have it better than a king!
- hanselot 3y ago
  I'm sorry, but as an AI language model, I am not qualified to give you advice on how to improve the build structure of your cardboard home. I advise you to speak to a qualified professional cardboardpenter or simply to go stand in the begging que in front of our headquarters in San Francisco. Feel free to take your home with you, given how long the line is.

LatteLazy 3y ago

No bonding, undefined, unmeasurable "commitments"...

guerrilla 3y ago

I feel like this is one of those things that belongs in those news clips you see at the beginning of a dystopian or post-apocalyptic sci-fi film. It's just vague PR that won't actually do anything of substance.

jonplackett 3y ago
Peace in our time is guaranteed. Neville Chamberlain would be proud

unixhero 3y ago

We need libre and open source to move faster.

guerrilla 3y ago
How? Where can we donate? What can we do?

DebtDeflation 3y ago

[flagged]

teeray 3y ago
It makes more sense when you realize AI Safety is about the safety of the companies making AI from competitors.
adolph 3y ago
Do you have a better physical world analogy than a "series of tubes" to describe bandwidth and latency? https://www.pcmag.com/news/a-remembrance-and-defense-of-ted-stevens-series-of-tubes https://www.pcmag.com/news/a-remembrance-and-defense-of-ted-... Comment in context: "They want to deliver vast amounts of information over the Internet. And again, the Internet is not something that you just dump something on. It's not a big truck. It's a series of tubes. And if you don't understand, those tubes can be filled and if they are filled, when you put your message in, it gets in line and it's going to be delayed by anyone that puts into that tube enormous amounts of material, enormous amounts of material." https://en.wikipedia.org/wiki/Series_of_tubes https://en.wikipedia.org/wiki/Series_of_tubes

blitzar 3y ago

Team America: World Police (2004) Lisa: Promise me you'll never die. Gary Johnston: You know I can't promise that. Lisa: If you did that, I would make love to you right now Gary Johnston: I promise I'll never die. https://www.youtube.com/watch?v=aplSQGHPmvI https://www.youtube.com/watch?v=aplSQGHPmvI Lisa Secures Commitments from Gary to Never Die.

throwaway72762 3y ago

This strikes me as the best outcome as long as it stops here. This lets the White House move on from the nonsense AI x-risk discussion without being attacked for not doing anything about it, and also doesn't let the companies use fake x-risk to kill off open source models.

freedomben 3y ago
I agree with you, but it isn't going to stop here: > Biden-Harris Administration will continue to take decisive action by developing an Executive Order and pursuing bipartisan legislation to keep Americans safe
- javier123454321 3y ago
  Ah the lengths they will go for our safety.
malfist 3y ago
Yes, let's hope it stops here. I have full faith in billionaires looking out for our best interests as a society
kalkin 3y ago
I'm a cynic but even so I've been surprised by how the tone of confident dismissal of x-risk as "nonsense" has been completely unaffected by the change in messenger from LW weirdos to Turning Award winners. Like people don't even feel the need to gesture at an argument, it's just supposed to be obvious. What's really going on is good open source vs evil corporate control, a lot of commenters are sure, and the government is just out-of-touch geriatric puppets—even as the "open source vs Micro$oft" narrative has been ported straight from the 90s to a world where the concrete policy question is "should Meta bear any responsibility for the consequences of their software releases."
- throwaway72762 3y ago
  Why should the tone have changed? The billionaires and AI godfathers talking about it now all were inspired by LW and scifi, and it's the same narrative: no need to care about people living today or real problems in the world when there's a scifi story about trillions of people in the future for whom we must sacrifice anything (except the billionaires and AI godfathers comfort, status, or money) in the present to protect.

kevinventullo 3y ago

Kind of like how the White House secured commitments from banks to manage systemic financial risks?

kevmo 3y ago
Another fine case of regulatory capture! https://en.wikipedia.org/wiki/Regulatory_capture https://en.wikipedia.org/wiki/Regulatory_capture
codyb 3y ago
The big banks were pretty stable in this last go around, and systemically it never really felt like there was much risk? So maybe some things are working?

josh_today 3y ago

[dead]

Imnimo 3y ago

>The companies commit to developing robust technical mechanisms to ensure that users know when content is AI generated, such as a watermarking system. I've seen some papers on watermarking, but none of them are what I'd call "robust" - they're easily defeated by making small changes to the data. Are the companies "committing" to overcome an unsolved (and possibly unsolvable) technical challenge?

zer0c00ler 3y ago

Companies commit to testing systems - well, what about the commitment to actual fix problems? Would have been nice to see that. Even right now there are known security vulnerabilities that were found through testing but haven’t been fixed.

option 3y ago

Harris is our AI “czar”. She is known to be generally “not the brightest person”. Which experiences/competence makes her AI czar? Imagine someone like that having a say on how country develops nuclear at the end of ww2.

classified 3y ago

Making the wolf the shepherd. What could possibly go wrong.

airstrike 3y ago

This reeks of ass-covering so we everyone can later say "We are sorry. We tried." followed by some more innocuous PR lingo Great for voters to sleep better at night. Useless for actually "managing AI risks" Not that those risks can seriously be managed long-term, IMHO. The prisoner's dilemma between nation states and corporations ensures someone will defect.

ilaksh 3y ago
Right. Check out the new Netflix documentary "Unknown: Killer Drones". Basically former soldiers running military tech companies with the experience of losing their friends in battle are looking at how DeepMind's AIs are undefeatable at Star Craft II, Go, and pretty much every game they train it for. And already testing plugging that type of thing into drones and jets. And now DeepMind wants to combine the language-based fairly general purpose reasoning ability of something like GPT with the superhuman strategic prowess of AlphaStar/AlphaZero/etc. At the latest big keynote Nvidia touted the fact that they have accelerated AI by a factor of one million over the last decade, and project that they will do so again in the next decade. Humans will not be able to compete at all, and even putting them in the decision loop will mean immediate failure. Human thought and action will "appear" to be so slow that it is essentially frozen compared to the operating speed of these systems.

codyb 3y ago

This actually seems semi decent for a first go? 140 million in funding for seven more research labs (might be a different order but still neat). Commitments for cybersecurity funding (probably already happening anyways), independent auditing, and some testing. The most interesting part was the watermarking. I'm interested to see how that works out, but it's a neat concept, something I hadn't thought of. I like the focus on reducing bias, that seems like a good effort and of course the focus on helping to cure cancer which I'm always a fan of Biden being such a champion of. Also reaching out to key allies to work together seems positive. I dunno, all in all, it seems kind of neat. Call me a wild eyed optimist or something.

frankfrankfrank 3y ago

[dead]

tastyfreeze 3y ago

Call me cynical but its hard to see this as anything but a way to create a moat for the incumbent leaders in the field.