3 ms·
I'm not that much worried about whether or not there's an asymptote of diminishing returns for self-improving intelligence. I'm quite a bit worried about just h
by rsaarelm 14y ago
I'm not that much worried about whether or not there's an asymptote of diminishing returns for self-improving intelligence. I'm quite a bit worried about just how far away a genuinely self-improving intelligent system will move from the level of human capacity before it starts hitting the wall.
I think Kurzweil is mostly the one who keeps going on about literal unending exponential growth. Vinge's original singularity idea was more about things just becoming irreversibly incomprehensible for regular humans, since ultimately limited or not, self-improving intelligences are going to end operating on a level very distant from human thought.