4 ms·
If we managed to create an AI that gets out of control, we would pose an existential threat to it due to our ability to create another even more powerful and un
by jarek-foksa 11y ago
If we managed to create an AI that gets out of control, we would pose an existential threat to it due to our ability to create another even more powerful and uncontrollable AI.
- robotresearcher 11y agoThat's a good point. But the AI could do that too, and maybe better.
- jarek-foksa 11y agoI would expect the first AI to improve itself (or produce a new AI) in a controlled and planned manner (from the perspective of that AI, not the humans). Intelligence explosion would look like an instant revolution to humans, but from the perspective of the AI it would be a lengthy evolution process. The second AI created by humans is unlikely to have same goals or to be predictable by the first AI (or whatever evolves from it), thus I guess it's something that the first AI would want to prevent, either by eliminating humans or by fully controlling them (for their own good). It's extremely important that the first AI we create is well thought out as we won't have the second chance to fix things up, once it's here it will have god-like powers over us.