4 ms·
"Exponentials" in nature almost always turn out to be be sigmoid functions when looked at over their full range. Intelligence in particular seems very very like
by tsimionescu 4y ago
"Exponentials" in nature almost always turn out to be be sigmoid functions when looked at over their full range. Intelligence in particular seems very very likely to be a sigmoid function, since scaling tends to produce diminishing returns as inter-node communication needs increase, just like we saw with CPU parallelism.
- DennisP 4y agoSure, but we have an existence proof for human-level intelligence, and there's no particular reason to believe humans are at the top of what's possible.
- tsimionescu 4y agoThere's no particular reason to believe anything about intelligence far greater than a human's either. And there's absolutely no reason to imagine that current AI tech, requiring more training data than the whole of humanity has ever consumed to train on tasks that humans acquire in 5-10 years, has any chance to reach significant improvements in general intelligence (which would certainly require on-the-fly training to adapt to new information).