4 ms·

“I don’t think Sam is the guy who should have the finger on the button for AGI.” - Ilya Sutskever, Co-founder, co-lead of Superalignment Team , Departed early

by angst 1y ago

“I don’t think Sam is the guy who should have the finger on the button for AGI.” - Ilya Sutskever, Co-founder, co-lead of Superalignment Team , Departed early 2024 - May 15, 2025, The Atlantic Anyway, I concur it's a hard choice as one other comment mentions.

catgary 1y ago
[flagged]
- Gigablah 1y ago
  Is that the du jour unit of measurement for morality now?
  - linotype 1y ago
    gestures broadly at every other thing we've known about Mark Zuckerberg since "Dumb Fucks" in college
- WJW 1y ago
  Even if it's zero, he could still be a shitty person who shouldn't have access to that button. If anyone should have such access at all, of course.
- renewiltord 1y ago
  I suppose as an American taxpayer and American voter, he is responsible for as many ethnic cleansings as anyone else. Supposedly, Armenians leaving Nagorno-Karabakh is ethnic cleansing, and the US did give aid to Azerbaijian so that makes Americans facilitators of ethnic cleansing, though admittedly so are the Canadians.
godelski 1y ago
Is this a button any one person should have their finger on?
- TFYS 1y ago
  Exactly. AGI is something that will significantly affect all of humanity. It should be treated like nuclear weapons.
  - zxexz 1y ago
    Effectively kept secret and in the shadows by those working on it, until a world-altering public display makes it a hot politically charged issue, unaltering even 80 years later? Edit: Honestly, I bet that "Altman", directed by Nolan's simulacrum and starring a de-aged Cillian Murphy (with or without his consent), will in fact deservedly win a few oscars in 2069.
    - jonplackett 1y ago
      And quickly proliferated around the world to other superpowers and rogue states… Remember the soviets got the nuke so quick because they just exfiltrated the US plans
    - TFYS 1y ago
      International co-operation to control development and usage. The decision to unleash AGI can only be made once. Making such a decision should not be done hastily, and definitely not for the reason of pursuing private profit. Such a decision needs input from all of humanity.
      - andsoitis 1y ago
        > International co-operation to control development and usage. Non-starter. Why would you trust your adversary to "stay within the lanes". The rational thing to do is to extend your lead as much as possible to be at the top of the pyramid. The arms race is on.
        TFYS 1y ago
        It's rational only if you don't consider the risks of an actual superhuman AGI. Geopolitical issues won't matter if such a thing is released without making sure it can be controlled. These competition based systems of ours will be the death of us. Nothing can be done in a wise manner when competiton forces our hand.
energy123 1y ago
I want Sam to win more than I do Zuck, just based on the proven negativity generated by Meta. I don't want that individual or that company anywhere near additional capital, power, capability or influence.
- baq 1y ago
  Between the trio of Thiel, Zuck and sama I’d pick the fourth option - I don’t want to be on that train anymore
  - ponector 1y ago
    Fourth option is Musk with xAI.
    - _Algernon_ 1y ago
      Fourth option is butlerian jihad
  - stackbutterflow 1y ago
    It became clear in 2024 and 2025 that they're all dangerous. All these tech billionaires or pseudo billionaires are basically believing that an enlightened dictatorship is the best form of governance. And of course they ought to be the dictator or part of the board.
- btheunissen 1y ago
  At the start of the “LLM boom” I was optimistic that OAI/Anthropic were in a position finally unseat the Big 4 in at least this area. Now I’m convinced the only winners are going to be Google, Meta, Amazon, and we are right back to where we started.
  - jcfrei 1y ago
    What makes you think so? They got the Chatgpt.com domain and the product seems to be growing more than any other (check out app downloads: https://appmagic.rocks/top-charts/apps https://appmagic.rocks/top-charts/apps). They got the first mover advantage - and as we know around here that's a huuuge advantage.
raverbashing 1y ago
Does any of those OpenAI spinoffs have something to show already or are they still "raising money"

by angst 1y ago

catgary 1y ago

[flagged]

Gigablah 1y ago
Is that the du jour unit of measurement for morality now?
- linotype 1y ago
  gestures broadly at every other thing we've known about Mark Zuckerberg since "Dumb Fucks" in college
WJW 1y ago
Even if it's zero, he could still be a shitty person who shouldn't have access to that button. If anyone should have such access at all, of course.
renewiltord 1y ago
I suppose as an American taxpayer and American voter, he is responsible for as many ethnic cleansings as anyone else. Supposedly, Armenians leaving Nagorno-Karabakh is ethnic cleansing, and the US did give aid to Azerbaijian so that makes Americans facilitators of ethnic cleansing, though admittedly so are the Canadians.

godelski 1y ago

Is this a button any one person should have their finger on?

TFYS 1y ago
Exactly. AGI is something that will significantly affect all of humanity. It should be treated like nuclear weapons.
- zxexz 1y ago
  Effectively kept secret and in the shadows by those working on it, until a world-altering public display makes it a hot politically charged issue, unaltering even 80 years later? Edit: Honestly, I bet that "Altman", directed by Nolan's simulacrum and starring a de-aged Cillian Murphy (with or without his consent), will in fact deservedly win a few oscars in 2069.
  - jonplackett 1y ago
    And quickly proliferated around the world to other superpowers and rogue states… Remember the soviets got the nuke so quick because they just exfiltrated the US plans
  - TFYS 1y ago
    International co-operation to control development and usage. The decision to unleash AGI can only be made once. Making such a decision should not be done hastily, and definitely not for the reason of pursuing private profit. Such a decision needs input from all of humanity.
    - andsoitis 1y ago
      > International co-operation to control development and usage. Non-starter. Why would you trust your adversary to "stay within the lanes". The rational thing to do is to extend your lead as much as possible to be at the top of the pyramid. The arms race is on.
      - TFYS 1y ago
        It's rational only if you don't consider the risks of an actual superhuman AGI. Geopolitical issues won't matter if such a thing is released without making sure it can be controlled. These competition based systems of ours will be the death of us. Nothing can be done in a wise manner when competiton forces our hand.

energy123 1y ago

I want Sam to win more than I do Zuck, just based on the proven negativity generated by Meta. I don't want that individual or that company anywhere near additional capital, power, capability or influence.

baq 1y ago
Between the trio of Thiel, Zuck and sama I’d pick the fourth option - I don’t want to be on that train anymore
- ponector 1y ago
  Fourth option is Musk with xAI.
  - _Algernon_ 1y ago
    Fourth option is butlerian jihad
- stackbutterflow 1y ago
  It became clear in 2024 and 2025 that they're all dangerous. All these tech billionaires or pseudo billionaires are basically believing that an enlightened dictatorship is the best form of governance. And of course they ought to be the dictator or part of the board.
btheunissen 1y ago
At the start of the “LLM boom” I was optimistic that OAI/Anthropic were in a position finally unseat the Big 4 in at least this area. Now I’m convinced the only winners are going to be Google, Meta, Amazon, and we are right back to where we started.
- jcfrei 1y ago
  What makes you think so? They got the Chatgpt.com domain and the product seems to be growing more than any other (check out app downloads: https://appmagic.rocks/top-charts/apps https://appmagic.rocks/top-charts/apps). They got the first mover advantage - and as we know around here that's a huuuge advantage.

raverbashing 1y ago

Does any of those OpenAI spinoffs have something to show already or are they still "raising money"