3 ms·

There's a wondeful youtube channel from a researcher who focusses exactly on this topic, I think you should check it out: https://www.youtube.com/watch?v=ZeecO

There's a wondeful youtube channel from a researcher who focusses exactly on this topic, I think you should check it out: https://www.youtube.com/watch?v=ZeecOKBus3Q https://www.youtube.com/watch?v=ZeecOKBus3Q

semi-extrinsic 4y ago
I watched the whole thing. Man spent a lot of breath asserting that an AGI will have broadly the same types of goals that humans do. Said exactly zero words about why we won't just be able to tell the AGI "no, you're not getting what you want", and then turn it off.
- dinosaurdynasty 4y ago
  He covers that in another video: https://www.youtube.com/watch?v=3TYT1QfdfsM https://www.youtube.com/watch?v=3TYT1QfdfsM
  - semi-extrinsic 4y ago
    Oh FFS. He starts off by giving the AGI a robot body that can kill things (don't do that in the first place!), and then he adds a stop button in a type of location that wouldn't pass muster on a table saw, let alone an industrial robot. If you've placed the stop button such that you cannot access it safely in all possible failure modes of the dangerous machine, be it bench grinder or an AGI or whatever, you have failed the very basics of industrial safety and you must go home and be sad, for you will not be receiving a cookie. And the thought experiments of this guy are completely incoherent. At the same time the robot has human-level (or greater) intelligence, yet is extremely stupid, and you can somehow program it in an extremely simplistic way. Sorry, but all you've convinced me of is that this is just a random guy on YouTube with no particular education of relevance nor other qualifications (I checked), who is very pleased about his own ideas and is quite lacking in the ability to think critically.
    - sabellito 4y ago
      I don't think you spent enough time checking, he's a person with a PHD precisely in AI safety! The type of reasoning you're displaying is addressed in another video: https://www.youtube.com/watch?v=9i1WlcCudpU https://www.youtube.com/watch?v=9i1WlcCudpU

semi-extrinsic 4y ago

I watched the whole thing. Man spent a lot of breath asserting that an AGI will have broadly the same types of goals that humans do. Said exactly zero words about why we won't just be able to tell the AGI "no, you're not getting what you want", and then turn it off.

dinosaurdynasty 4y ago
He covers that in another video: https://www.youtube.com/watch?v=3TYT1QfdfsM https://www.youtube.com/watch?v=3TYT1QfdfsM
- semi-extrinsic 4y ago
  Oh FFS. He starts off by giving the AGI a robot body that can kill things (don't do that in the first place!), and then he adds a stop button in a type of location that wouldn't pass muster on a table saw, let alone an industrial robot. If you've placed the stop button such that you cannot access it safely in all possible failure modes of the dangerous machine, be it bench grinder or an AGI or whatever, you have failed the very basics of industrial safety and you must go home and be sad, for you will not be receiving a cookie. And the thought experiments of this guy are completely incoherent. At the same time the robot has human-level (or greater) intelligence, yet is extremely stupid, and you can somehow program it in an extremely simplistic way. Sorry, but all you've convinced me of is that this is just a random guy on YouTube with no particular education of relevance nor other qualifications (I checked), who is very pleased about his own ideas and is quite lacking in the ability to think critically.
  - sabellito 4y ago
    I don't think you spent enough time checking, he's a person with a PHD precisely in AI safety! The type of reasoning you're displaying is addressed in another video: https://www.youtube.com/watch?v=9i1WlcCudpU https://www.youtube.com/watch?v=9i1WlcCudpU