3 ms·
You know I agree that superintelligence is totally possible, but what I disagree with is that it follows immediately after AGI. Suppose you reach the level of A
by golol 3y ago
You know I agree that superintelligence is totally possible, but what I disagree with is that it follows immediately after AGI. Suppose you reach the level of AGI. Then your AGI can not just write down the weights for a smarter AI. It has roughly the intelligence of humans, so to build a better AI it would have to do something similar to what humans do: Large scale training on large computers . This takes time and is easily supervisable. I don't see a risk of rapid singularity like intelligence blow up. There is a risk of the AGI escaping but since it needs aignificant amounts of compute, and does mot have the intelligence to just rewrite itself into a decentralized abstract form, I again don't see a big danger. When we are at this stage we can start worrying about superintelligence, as well as AI rights and digital citzenship obviously.