3 ms·
This seems like a very big, pretty unreasonable assumption: "Assuming that a superintelligence will contain a program that includes all the programs that can be
by argonaut 10y ago
This seems like a very big, pretty unreasonable assumption: "Assuming that a superintelligence will contain a program that includes all the programs that can be executed by a universal Turing machine on input potentially as complex as the state of the world"
This assumption is essentially assuming that "superintelligence" means "god-like intelligence" (god-like because it can compute anything about the world), which is not what the first AGIs that are even significantly smarter than humans would look like.
- tim333 10y agoIndeed, the argument seems a bit nuts. I think a more solid argument for superintelligence not being contained is that human minds will merge with it given the chance so it'll get the same rights as the rest of us.
- ccvannorman 10y agoI think the author has the unstated assumption that "humans will continue to work on smarter and better machines until such a god-like machine is eventually constructed, OR that machines will be created that can self-improve until this state is reached." It doesn't seem unreasonable to me -- the alternative is that at some point in the future, we STOP making machines smarter for good.
- argonaut 10y agoThere is no reason to believe it is even possible to even create such a God-like intelligence. Even harnessing the energy of the sun would not give you enough energy to compute anything about the universe. We also have every reason to believe that even if this were possible, it would only happen in the far future (e.g. hundreds of years).