3 ms·

Please read and study my comments in this thread carefully. Superintelligence is not Hollywood bullshit. AI doesn't need to be alive or animal-like to be super

by ilaksh 3y ago

Please read and study my comments in this thread carefully. Superintelligence is not Hollywood bullshit. AI doesn't need to be alive or animal-like to be superintelligent. We have many examples getting more and more general purpose. Look at AlphaGo, AlphaStar. Both are superintelligent in a somewhat narrow way (but trending towards less narrow). GPT-4 is superintelligent in some ways already such as it's breadth of knowledge. And we have to anticipate that it will continue to get smarter and better at reasoning and much, much faster. Over the last ten years AI performance has increased by 100000 to 1000000 depending on how you measure it. It will continue to accelerate. BTW, as far as internships etc., I started programming 38 years ago when I was 7. I've built a ton of software with numerous technologies, including recently some things like: a multilayer perceptron (from scratch). And a data analysis tool that uses GPT to write complex SQL and create charts on the fly to answer user requests. Also software to automatically create custom websites (including imagery) based on short descriptions, or automatically write, test and debug scripts on servers. And all of that outputs at superhuman speed already. And before that I worked on dozens of other complex projects. Point being, I understand technology and AI, and it is ludicrous to view superintelligence as "stupid bullshit".

mrguyorama 3y ago
Consider this: There are people much much smarter than you RIGHT NOW that you do not listen to or refuse to agree with. There are clear statistics RIGHT NOW about things that you choose to disbelieve. If you don't think this is true, then it is even more the reality. The idea that a very smart "AI" can magically convince anyone of anything is completely unsubstantiated and made entirely up, by people basically inventing a new god and religion. Everything about the human brain is built around rationalizing what you already want into whatever system you pretend to believe in and use, and an AI could tell you something completely true, completely accurate, completely right from a magical objective morality and you STILL would not choose to believe it.
- johngladtj 3y ago
  Given that we already have AI convincing people to kill themselves or that they are aware, I'd say the chance that a more advanced ai is capable of convincing humans to do certain actions that the human may not fully understand the totality of the consequences is pretty high.
  - mrguyorama 3y ago
    And plenty of people are convinced of god by an "image" on toast. The existence of very gullible people does not imply that ANYONE is always convincible by a sufficiently "magical super-intelligent" "AI". People bring up "oh but think of it like your mental superiority to ants" and well, go ahead and convince a colony of ants to nuke russia, I'll wait. There are already millions of people that are stupidly easy to convince of anything, so why aren't these magical end of the world scenarios already happening? Where's the evil maniac convincing Kelly the soccer mom who is into MLMs to end the world? Where is the supervillain raising an army of a million gullible idiots to invade Canada and have their own kingdom? AGI "Superintelligence" even as a concept is just completely unsupported. It's people looking at an extremely cropped graph and saying "Line goes up, must go up forever" and wouldn't you know it that group has massive overlap with those MLM people from before.

by ilaksh 3y ago

mrguyorama 3y ago

Consider this: There are people much much smarter than you RIGHT NOW that you do not listen to or refuse to agree with. There are clear statistics RIGHT NOW about things that you choose to disbelieve. If you don't think this is true, then it is even more the reality. The idea that a very smart "AI" can magically convince anyone of anything is completely unsubstantiated and made entirely up, by people basically inventing a new god and religion. Everything about the human brain is built around rationalizing what you already want into whatever system you pretend to believe in and use, and an AI could tell you something completely true, completely accurate, completely right from a magical objective morality and you STILL would not choose to believe it.

johngladtj 3y ago
Given that we already have AI convincing people to kill themselves or that they are aware, I'd say the chance that a more advanced ai is capable of convincing humans to do certain actions that the human may not fully understand the totality of the consequences is pretty high.
- mrguyorama 3y ago
  And plenty of people are convinced of god by an "image" on toast. The existence of very gullible people does not imply that ANYONE is always convincible by a sufficiently "magical super-intelligent" "AI". People bring up "oh but think of it like your mental superiority to ants" and well, go ahead and convince a colony of ants to nuke russia, I'll wait. There are already millions of people that are stupidly easy to convince of anything, so why aren't these magical end of the world scenarios already happening? Where's the evil maniac convincing Kelly the soccer mom who is into MLMs to end the world? Where is the supervillain raising an army of a million gullible idiots to invade Canada and have their own kingdom? AGI "Superintelligence" even as a concept is just completely unsupported. It's people looking at an extremely cropped graph and saying "Line goes up, must go up forever" and wouldn't you know it that group has massive overlap with those MLM people from before.