5 ms·

If it gets us to AGI faster, I frankly don't give a fuck. AGI-driven drug discovery will save billions of lives. Every day it is delayed costs tens of thousand

If it gets us to AGI faster, I frankly don't give a fuck. AGI-driven drug discovery will save billions of lives. Every day it is delayed costs tens of thousands of lives. No amount of copyright is worth that sacrifice.

artninja1988 3y ago
Heh. Bit too high of a bar. Even if it helps to develop boo about 9000 that's fun to prooomt for a while, I think it's fair game
peddling-brink 3y ago
AGI will mean we’re no longer the dominant life form on the planet. If AGI were achieved tomorrow, how many humans would be left in 200 years?
- soultrees 3y ago
  I find this notion interesting. What makes you think AI will automatically kill humans?
  - pr337h4m 3y ago
    And moreover, what makes people even think that a desire to commit mass murder is an innate characteristic of an 'intelligent' being, that increases the more 'intelligent' it becomes? (If they believe themselves to be 'intelligent', do they believe they have a greater desire to commit mass murder?)
    - peddling-brink 3y ago
      This, “desire”, “murder”, “belief” is human thinking about what humans would do. It may not apply to a superhuman machine intelligence.
      - deleted 3y ago
        [deleted]
  - ALittleLight 3y ago
    I don't think it's certain the AI kills everyone, but it's not certainly impossible either. It depends on how the AI works and what it "wants" for some value of "wants". Humans have not been particularly kind to the species less intelligent than us. Why would we anticipate being well treated by an entity more intelligent than us? Even if we're not that relevant to a super intelligence, creating one forfeits human control over the Earth and known universe to the machines. Right now, in a century or two or three or whatever - we might be building Dyson Spheres and colonizing the galaxy. In an alternate and plausible timeline the machines are doing that and we are not.
  - JoshTriplett 3y ago
    If it isn't aligned with humans and doesn't understand exactly what humans want it to do, then you're just made of matter that it doesn't know not to repurpose. It's not that it makes a deliberate decision to "kill" you, it's that understanding "kill" to a sufficient degree to not do it as a side effect is halfway to alignment already. When we plow a field, we don't check for mouse burrows first. When we cut down a tree for lumber, we don't check for ants in the way of the chainsaw. Preempting the obvious response: if your thought is "we don't let AI do those things directly, we just ask it for information", consider that for a sufficiently powerful and unaligned AI, you don't have to let an AI out of the box, it can let itself out. (And that's leaving aside that we hand some AIs Internet access.)
- valine 3y ago
  200 years with AGI? I’d be shocked if there weren’t a few hundred billion humans spread across the solar system.
  - peddling-brink 3y ago
    Are you envisioning AGI as something akin to a pet? A fun talking robot? GPT4? Imagine you just woke up on the planet of the apes. You smile and act friendly because you don’t want them to beat you with their clubs. You start helping them with things. Apply some elementary logic that they can’t seem to get, but they appreciate your contributions. But to keep themselves safe from you, they’ve locked up their sharpest sticks and won’t let you touch them. Are their preventative measures sufficient? Do you even need their sharp sticks to accomplish your goals? Hey, what are your goals anyway? Do they “align” with the apes?
    - scotty79 3y ago
      I imagine we'll be the pets of AGI. And look how our pets thrive in comparison to wildlife. Even our cattle thrive in comparison to wildlife.
      - DesiLurker 3y ago
        okay, are you willing to risk the entire humanity and all the biosphere on that glimmer of hope? even if you or the SV VC types are that stupid why should they get to decide the fate of all of us? how would US feel if a bunch of VCs in China decided to build a 'not-well-tested-potentially-kill-all-humans AGI'?
        scotty79 3y ago
        Humanity existance is by itself a risk. You can't predict if AGI will increase our risks or decrease it. Humanity's behavior depends on the circumstances of population dynamics, economy and technology. Who knows, maybe without AGI we are bound to inevitably start nuking ourselves in 10 years because of shrinking resources and growing divides. You can't decide the future. You can only do what you think is best in given circumstances and hope for a good one.
- briansm 3y ago
  "See, those things, they can work real hard, buy themselves time to write cookbooks or whatever, but the minute, I mean the nanosecond, that one starts figuring out ways to make itself smarter, Turing'll wipe it. Nobody trusts those fuckers, you know that. Every AI ever built has an electromagnetic shotgun wired to its forehead." - Neuromancer, William Gibson, 1984.
  - xvector 3y ago
    Self-fulfilling prophecy - if people don't trust AI, and there will be a proverbial "electromagnetic shotgun" wired to its foreheard, it will be because of the doomers that insist we cannot trust AI. This is why we can't have nice things. How I detest doomers.

artninja1988 3y ago

Heh. Bit too high of a bar. Even if it helps to develop boo about 9000 that's fun to prooomt for a while, I think it's fair game

peddling-brink 3y ago

AGI will mean we’re no longer the dominant life form on the planet. If AGI were achieved tomorrow, how many humans would be left in 200 years?

soultrees 3y ago
I find this notion interesting. What makes you think AI will automatically kill humans?
- pr337h4m 3y ago
  And moreover, what makes people even think that a desire to commit mass murder is an innate characteristic of an 'intelligent' being, that increases the more 'intelligent' it becomes? (If they believe themselves to be 'intelligent', do they believe they have a greater desire to commit mass murder?)
  - peddling-brink 3y ago
    This, “desire”, “murder”, “belief” is human thinking about what humans would do. It may not apply to a superhuman machine intelligence.
    - deleted 3y ago
      [deleted]
- ALittleLight 3y ago
  I don't think it's certain the AI kills everyone, but it's not certainly impossible either. It depends on how the AI works and what it "wants" for some value of "wants". Humans have not been particularly kind to the species less intelligent than us. Why would we anticipate being well treated by an entity more intelligent than us? Even if we're not that relevant to a super intelligence, creating one forfeits human control over the Earth and known universe to the machines. Right now, in a century or two or three or whatever - we might be building Dyson Spheres and colonizing the galaxy. In an alternate and plausible timeline the machines are doing that and we are not.
- JoshTriplett 3y ago
  If it isn't aligned with humans and doesn't understand exactly what humans want it to do, then you're just made of matter that it doesn't know not to repurpose. It's not that it makes a deliberate decision to "kill" you, it's that understanding "kill" to a sufficient degree to not do it as a side effect is halfway to alignment already. When we plow a field, we don't check for mouse burrows first. When we cut down a tree for lumber, we don't check for ants in the way of the chainsaw. Preempting the obvious response: if your thought is "we don't let AI do those things directly, we just ask it for information", consider that for a sufficiently powerful and unaligned AI, you don't have to let an AI out of the box, it can let itself out. (And that's leaving aside that we hand some AIs Internet access.)
valine 3y ago
200 years with AGI? I’d be shocked if there weren’t a few hundred billion humans spread across the solar system.
- peddling-brink 3y ago
  Are you envisioning AGI as something akin to a pet? A fun talking robot? GPT4? Imagine you just woke up on the planet of the apes. You smile and act friendly because you don’t want them to beat you with their clubs. You start helping them with things. Apply some elementary logic that they can’t seem to get, but they appreciate your contributions. But to keep themselves safe from you, they’ve locked up their sharpest sticks and won’t let you touch them. Are their preventative measures sufficient? Do you even need their sharp sticks to accomplish your goals? Hey, what are your goals anyway? Do they “align” with the apes?
  - scotty79 3y ago
    I imagine we'll be the pets of AGI. And look how our pets thrive in comparison to wildlife. Even our cattle thrive in comparison to wildlife.
    - DesiLurker 3y ago
      okay, are you willing to risk the entire humanity and all the biosphere on that glimmer of hope? even if you or the SV VC types are that stupid why should they get to decide the fate of all of us? how would US feel if a bunch of VCs in China decided to build a 'not-well-tested-potentially-kill-all-humans AGI'?
      - scotty79 3y ago
        Humanity existance is by itself a risk. You can't predict if AGI will increase our risks or decrease it. Humanity's behavior depends on the circumstances of population dynamics, economy and technology. Who knows, maybe without AGI we are bound to inevitably start nuking ourselves in 10 years because of shrinking resources and growing divides. You can't decide the future. You can only do what you think is best in given circumstances and hope for a good one.
briansm 3y ago
"See, those things, they can work real hard, buy themselves time to write cookbooks or whatever, but the minute, I mean the nanosecond, that one starts figuring out ways to make itself smarter, Turing'll wipe it. Nobody trusts those fuckers, you know that. Every AI ever built has an electromagnetic shotgun wired to its forehead." - Neuromancer, William Gibson, 1984.
- xvector 3y ago
  Self-fulfilling prophecy - if people don't trust AI, and there will be a proverbial "electromagnetic shotgun" wired to its foreheard, it will be because of the doomers that insist we cannot trust AI. This is why we can't have nice things. How I detest doomers.