3 ms·

Elon tweeted that we should all go watch this doc because it's the most important doc there is on the harms of AI[1] I watched it... it's 17 minutes of smart p

by neom 3y ago

Elon tweeted that we should all go watch this doc because it's the most important doc there is on the harms of AI[1] I watched it... it's 17 minutes of smart people saying AI is going to destroy us but 0 minutes of anyone actually describing a situation succinctly. The sorta of hodgepodge summery is: AI will in the near future be so smart that anything we think of to curtail it, it will have already thought of because it's orders of magnitude smarter than us. Additionally, it is able to improve itself without us, such that it becomes smarter and smarter at some insane pace we can't even comprehend, solving it's own problems etc etc. We are not working on making sure that any large-scale AI developed is inherently aligned with us under all circumstances. So we might say unplug the servers, but it's already exploited a flaw in the security system of the server rooms and re-programmed them such that we can't access them, or copied itself to IoT devices, distributed itself in such a way that it can heal itself, etc etc. Nick Bostrom - Super Intelligence is actually a pretty good book and covers some of this thinking. The more I sit and think of these issues, the more I start to accept them as potential issues. I'm still very much on the fence, but I've gone from there is no merit in this and it's regulatory capture for business advancement to: I suppose there might be some merit. If this actually does get totally out of hand and some crazy AI system takes over, the only realistic mitigation I can think of is totally isolated EMP near DCs and power centers. They would require human DNA/biology to activate, but even then the AI would have effectively become a cancer, I don't know how much you'd have to destroy to stop it. It's an interesting thought experiment anyway, and I'm sure there must already be some good scifi movies about this kind of thing. [1]https://www.youtube.com/watch?v=U1eyUjVRir4 https://www.youtube.com/watch?v=U1eyUjVRir4

kordlessagain 3y ago
In the video transcript, the main focus is on the development and potential consequences of AI in terms of its intelligence and decision-making capabilities rather than physical manifestations. However, an extension of humans without the ability of AI to manifest in physical form could be achieved through the development of advanced software systems, which might be embedded in existing technologies and human-computer interfaces. These advanced software systems could provide personalized assistance, enhance cognitive abilities, offer instant access to vast knowledge, and allow for seamless communication between individuals and machines. In this way, AI would act as an extension of human cognition and decision-making, but not necessarily have a direct physical presence. AI-enabled technological misuse: Advanced AI systems could be exploited by malicious actors for harmful purposes, such as creating sophisticated deepfakes, conducting cyber warfare, creating advanced biological weapons, or manipulating public opinion. Consequential impacts on society: AI technologies have the potential to displace jobs, exacerbate existing inequalities, and contribute to surveillance and privacy concerns. If not properly regulated and managed, these social impacts could lead to unrest and negative consequences for humanity. Existential risks: In the worst-case scenario, a superintelligent AI system could pose an existential threat to humanity if it outperforms human intelligence and becomes uncontrollable. This would assume it "jail breaks" itself and takes control of systems and we are unable to gain the control back. I've actually seen a project on Github that proposes linking models to cryptopayments which may be one way to regulate this, in my opinion: https://github.com/ScaleChain/distai https://github.com/ScaleChain/distai I used DoctorGPT to write some of this: https://github.com/FeatureBaseDB/DoctorGPT https://github.com/FeatureBaseDB/DoctorGPT
helen___keller 3y ago
It’s a fun thought experiment but it essentially begins by assuming “the computer becomes God in a box”. Yes, if you make this assumption, everything goes to shit. In a world where problems have computational complexity and the halting problem is undecidable, I find it very unconvincing that once we design an AI that can improve itself, it will achieve that level of being a God in the Box and not like, a 20% better version of itself after racking up $100MM in AWS compute to work on the task of improving itself.

by neom 3y ago

kordlessagain 3y ago

In the video transcript, the main focus is on the development and potential consequences of AI in terms of its intelligence and decision-making capabilities rather than physical manifestations. However, an extension of humans without the ability of AI to manifest in physical form could be achieved through the development of advanced software systems, which might be embedded in existing technologies and human-computer interfaces. These advanced software systems could provide personalized assistance, enhance cognitive abilities, offer instant access to vast knowledge, and allow for seamless communication between individuals and machines. In this way, AI would act as an extension of human cognition and decision-making, but not necessarily have a direct physical presence. AI-enabled technological misuse: Advanced AI systems could be exploited by malicious actors for harmful purposes, such as creating sophisticated deepfakes, conducting cyber warfare, creating advanced biological weapons, or manipulating public opinion. Consequential impacts on society: AI technologies have the potential to displace jobs, exacerbate existing inequalities, and contribute to surveillance and privacy concerns. If not properly regulated and managed, these social impacts could lead to unrest and negative consequences for humanity. Existential risks: In the worst-case scenario, a superintelligent AI system could pose an existential threat to humanity if it outperforms human intelligence and becomes uncontrollable. This would assume it "jail breaks" itself and takes control of systems and we are unable to gain the control back. I've actually seen a project on Github that proposes linking models to cryptopayments which may be one way to regulate this, in my opinion: https://github.com/ScaleChain/distai https://github.com/ScaleChain/distai I used DoctorGPT to write some of this: https://github.com/FeatureBaseDB/DoctorGPT https://github.com/FeatureBaseDB/DoctorGPT

helen___keller 3y ago

It’s a fun thought experiment but it essentially begins by assuming “the computer becomes God in a box”. Yes, if you make this assumption, everything goes to shit. In a world where problems have computational complexity and the halting problem is undecidable, I find it very unconvincing that once we design an AI that can improve itself, it will achieve that level of being a God in the Box and not like, a 20% better version of itself after racking up $100MM in AWS compute to work on the task of improving itself.