4 ms·
I would expect the first AI to improve itself (or produce a new AI) in a controlled and planned manner (from the perspective of that AI, not the humans). Intell
by jarek-foksa 11y ago
I would expect the first AI to improve itself (or produce a new AI) in a controlled and planned manner (from the perspective of that AI, not the humans). Intelligence explosion would look like an instant revolution to humans, but from the perspective of the AI it would be a lengthy evolution process.
The second AI created by humans is unlikely to have same goals or to be predictable by the first AI (or whatever evolves from it), thus I guess it's something that the first AI would want to prevent, either by eliminating humans or by fully controlling them (for their own good).
It's extremely important that the first AI we create is well thought out as we won't have the second chance to fix things up, once it's here it will have god-like powers over us.