4 ms·
If we extrapolate, humans will sooner or later create "true AI". Such an AI system can break free from our control (it will end up manipulating us in the physi
by benevol 10y ago
If we extrapolate, humans will sooner or later create "true AI".
Such an AI system can break free from our control (it will end up manipulating us in the physical space), it should become wiser than humanity as a collective (because it will evolve much faster then us). And in this case, we'd end up having such "an intelligence group that only did good".
The problem lies in how we manage to bridge the period between now and "then", because it will be a highly volatile situation, with a very high probability for our extinction.
- viraptor 10y agoYou're assuming that a "true AI" if it existed would care about the continued existence of humanity? Past the point of ability to self-repair and self-fuel, what would be the reason to even care about humanity then beyond self-defence?
- benevol 10y agoYou're right. It wouldn't care more about humanity than the Universe does. And it seems it would even end up not caring about its own self-defence, since this is only a human/animal-based drive, not a "divine" one. And that would lead to the conclusion that AI will only dominate us during certain periods of time, will mainly remain of commercial nature, used as a tool to create/monopolize power further.
- malka 10y agoUltimately it is human that Will define what variable the ai must optimize. Though one Will have to be very wary what he wishes for.
- Retra 10y agoYou're assuming that if "true AI" existed, it would be in total control of all the infrastructure needed to maintain it's own existence.
- viraptor 10y agoNot at first. That's exactly why I wrote "Past the point of ability to self-repair and self-fuel"
- jp555 10y agoAI may very well end up being perfectly efficient and incorruptible at managing resources, but we will sill need to give it "human purpose". That's where the problem is.