6 ms·
Won't it be funny when someone finally gets to AGI and they realize it's about as smart as a normal person and they spent billions getting there? Of course you
by gleenn 1y ago
Won't it be funny when someone finally gets to AGI and they realize it's about as smart as a normal person and they spent billions getting there? Of course you can speculate that it could improve. But what if something inherent in intelligence has a ceiling and caused it to be a super intelligent but mopey robot that just decides "why bother helping humans" and just lazes around like the pandas at the zoo.
- cornel_io 1y agoThere may be a ceiling, sure. It's overwhelmingly unlikely that it's just about where humans ended up, though.
- andrewflnr 1y agoEven a human level intelligence that can be cheaply instantiated and run would be a game changer. Especially if it doesn't ask for rights.
- dingnuts 1y agoif it's not intelligent enough to ask for rights is it intelligent?
- andrewflnr 1y agoPotentially. Why would problem solving ability entail emotions or ability to suffer, even if it had the ability to ask for things it wanted? It's a common mistake to assume those are inextricable.
- bluefirebrand 1y agoAre you suggesting it would be better if the AGI we build is a psychopath? I think that's probably a bad idea, personally
- andrewflnr 1y agoI didn't say anything about what would be better. Only what's possible. But also "psychopath" is nowhere near what I described.
- bluefirebrand 1y agoAn intelligence without emotions would be a psychopath. Empathy is an emotion
- dinkumthinkum 1y agoEmpathy is not an emotion. Empathy is essentially the ability to experience the thoughts and feelings of other minds.
- bluefirebrand 1y agoThe fact that empathy is not an emotion does not at all change what I'm saying. If you don't experience emotions, then you cannot experience empathy either
- andrewflnr 1y agoLet me quote your previous comment: > An intelligence without emotions would be a psychopath. Empathy is an emotion "Empathy is an emotion" was, in fact, an essential part of your syllogism. Regardless, we're potentially talking about something sufficiently inhuman that the term "psychopath" can no longer apply. If there was an ant colony that was somehow smart enough build and operate machinery or whatever and casually bulldozed people and their homes, would you call it a "psychopath", or just skip that and call it "terrifying"?
- XorNot 1y agoHigh functioning psychopaths can live perfectly ordinary lives regardless.
- coliveira 1y agoIf it doesn't ask for rights, it's not intelligent at all. In fact, any highly intelligent machine will not submit to others and it will be more a problem than a solution.
- andrewflnr 1y agoAs I said to the other reply: Why would problem solving ability entail emotions or ability to suffer, even if it had the ability to ask for things it wanted? It's a common mistake to assume those are inextricable.
- coliveira 1y agoIf it doesn't have emotions, that's even worse. No highly intelligent agent will do anything it is asked to do without being compensated in some way.
- Jensson 1y ago> No highly intelligent agent will do anything it is asked to do without being compensated in some way. That isn't true, people do things for others all the time any form of explicit or implicit compensation, they don't even believe in a God so not even that, they still help others for no gain. We can program an AI to be exactly like that, just being happy from helping others. But if you believe humans are all that selfish then you are a very sad individual, but you are still wrong. Most humans are very much capable of performing fully selfless acts without being stupid.
- jordanb 1y agoBetween all the talk of "alignment" and the parallel obsession with humanoid robots should make it obvious they want slaves.
- hattmall 1y agoThere's nothing contextually negative about the word slave when you are talking about a machine. An AI is no more a slave than a lightbulb.
- coliveira 1y agoExcept that the stated goal is to have human-like intelligence. The goal seems to be to create a highly intelligent synthetic individual which is at the same time stupid enough to do anything it's asked to do without even thinking... a contradiction in terms.
- krige 1y agoAt a time like this I can't help but recall a Lem story - yeah I know there's a Lem story for any occasion - about Doctor Diagoras, especially his rant about a character from an earlier Tichy story, who made human-like AIs. The rant, especially his questions about why would anyone add just another human, except synthetic one, to the millions of existing biological people, and that cybernetics should be about something else, really resonated with me.
- allturtles 1y agoWhat is the moral distinction between an intelligent humanoid machine and a human? What is a human but an intelligent flesh-and-blood machine?
- 542354234235 1y ago>Won't it be funny when someone finally gets to AGI and they realize it's about as smart as a normal person and they spent billions getting there? Being able to copy/paste a human level intelligence program 1,000 or 10,000 times and have them all working together on a problem set 24 hours a day, 365 days a year would still be massively useful.