3 ms·
Intelligence is the manifold that these brute-force algorithms learn. Of course we don’t brute-force this in our lifetime. Evolution encoded the coarse structu
by theptip 1y ago
Intelligence is the manifold that these brute-force algorithms learn.
Of course we don’t brute-force this in our lifetime. Evolution encoded the coarse structure of the manifold over billions of years. And then encoded a hyper-compressed meta-learning algorithm into primates across millions of years.
- uecker 1y agoLearning a manifold is not intelligence as it lacks the reasoning part.
- esafak 1y agoLeaning the manifold is understanding. Reasoning, which takes place on the manifold, is applying that understanding.
- uecker 1y agoI am not sure what you definition of "understanding" is that you apply here.
- esafak 1y agoI mean understanding physics and the universe of natural possibilities; what can happen. Then comes why.
- uecker 1y agoFitting a manifold to a bunch of samples does not allow you to understand what can happen in the universe. For example, if you train a regular diffusion model on correct sudokus, it will produce sudokus with errors because it does not understand the rules.
- esafak 1y agoYou raise a good point for the diffusion case, which trains only on positive examples, but generally speaking negative examples will warp the manifold appropriately.
- uecker 1y agoSure, but you show a few correct examples to a human it will quickly pick up the correct rules. And this is understanding.