4 ms·

200 years with AGI? I’d be shocked if there weren’t a few hundred billion humans spread across the solar system.

by valine 3y ago

peddling-brink 3y ago
Are you envisioning AGI as something akin to a pet? A fun talking robot? GPT4? Imagine you just woke up on the planet of the apes. You smile and act friendly because you don’t want them to beat you with their clubs. You start helping them with things. Apply some elementary logic that they can’t seem to get, but they appreciate your contributions. But to keep themselves safe from you, they’ve locked up their sharpest sticks and won’t let you touch them. Are their preventative measures sufficient? Do you even need their sharp sticks to accomplish your goals? Hey, what are your goals anyway? Do they “align” with the apes?
- scotty79 3y ago
  I imagine we'll be the pets of AGI. And look how our pets thrive in comparison to wildlife. Even our cattle thrive in comparison to wildlife.
  - DesiLurker 3y ago
    okay, are you willing to risk the entire humanity and all the biosphere on that glimmer of hope? even if you or the SV VC types are that stupid why should they get to decide the fate of all of us? how would US feel if a bunch of VCs in China decided to build a 'not-well-tested-potentially-kill-all-humans AGI'?
    - scotty79 3y ago
      Humanity existance is by itself a risk. You can't predict if AGI will increase our risks or decrease it. Humanity's behavior depends on the circumstances of population dynamics, economy and technology. Who knows, maybe without AGI we are bound to inevitably start nuking ourselves in 10 years because of shrinking resources and growing divides. You can't decide the future. You can only do what you think is best in given circumstances and hope for a good one.
- DesiLurker 3y ago
  this is the analogy I often find myself gravitating towards. except that I also add the apes are about a 1000x slower than you in speed of thought so you see everything happening in super-slo-mo. add to that the fact that we've now fully 'unboxed' the AI & put it on internet so it also means opening all the confession boxes & private communications to it. yeah its all gonna go great! if have any doubts about all our private comms being available to AGI, I'll remind that we already have tonnes of societal data collected by govt mandated backdoors in our infra everywhere. AGI just has to hijack that which guess what they are already training one for. Most AI safety debates I watch (& I watch many) mostly go like .. trust us we'll get it right. thats like Apes in your analogy going oh nevermind the humans, they will be kind to us because we've trained them to be. ya right.

200 years with AGI? I’d be shocked if there weren’t a few hundred billion humans spread across the solar system.

by valine 3y ago

200 years with AGI? I’d be shocked if there weren’t a few hundred billion humans spread across the solar system.

Are you envisioning AGI as something akin to a pet? A fun talking robot? GPT4? Imagine you just woke up on the planet of the apes. You smile and act friendly because you don’t want them to beat you with their clubs. You start helping them with things. Apply some elementary logic that they can’t seem to get, but they appreciate your contributions. But to keep themselves safe from you, they’ve locked up their sharpest sticks and won’t let you touch them. Are their preventative measures sufficient? Do you even need their sharp sticks to accomplish your goals? Hey, what are your goals anyway? Do they “align” with the apes?

scotty79 3y ago
I imagine we'll be the pets of AGI. And look how our pets thrive in comparison to wildlife. Even our cattle thrive in comparison to wildlife.
- DesiLurker 3y ago
  okay, are you willing to risk the entire humanity and all the biosphere on that glimmer of hope? even if you or the SV VC types are that stupid why should they get to decide the fate of all of us? how would US feel if a bunch of VCs in China decided to build a 'not-well-tested-potentially-kill-all-humans AGI'?
  - scotty79 3y ago
    Humanity existance is by itself a risk. You can't predict if AGI will increase our risks or decrease it. Humanity's behavior depends on the circumstances of population dynamics, economy and technology. Who knows, maybe without AGI we are bound to inevitably start nuking ourselves in 10 years because of shrinking resources and growing divides. You can't decide the future. You can only do what you think is best in given circumstances and hope for a good one.
DesiLurker 3y ago
this is the analogy I often find myself gravitating towards. except that I also add the apes are about a 1000x slower than you in speed of thought so you see everything happening in super-slo-mo. add to that the fact that we've now fully 'unboxed' the AI & put it on internet so it also means opening all the confession boxes & private communications to it. yeah its all gonna go great! if have any doubts about all our private comms being available to AGI, I'll remind that we already have tonnes of societal data collected by govt mandated backdoors in our infra everywhere. AGI just has to hijack that which guess what they are already training one for. Most AI safety debates I watch (& I watch many) mostly go like .. trust us we'll get it right. thats like Apes in your analogy going oh nevermind the humans, they will be kind to us because we've trained them to be. ya right.