4 ms·
Learning a manifold is not intelligence as it lacks the reasoning part.
by uecker 1y ago
Learning a manifold is not intelligence as it lacks the reasoning part.
- esafak 1y agoLeaning the manifold is understanding. Reasoning, which takes place on the manifold, is applying that understanding.
- uecker 1y agoI am not sure what you definition of "understanding" is that you apply here.
- esafak 1y agoI mean understanding physics and the universe of natural possibilities; what can happen. Then comes why.
- uecker 1y agoFitting a manifold to a bunch of samples does not allow you to understand what can happen in the universe. For example, if you train a regular diffusion model on correct sudokus, it will produce sudokus with errors because it does not understand the rules.
- esafak 1y agoYou raise a good point for the diffusion case, which trains only on positive examples, but generally speaking negative examples will warp the manifold appropriately.
- uecker 1y agoSure, but you show a few correct examples to a human it will quickly pick up the correct rules. And this is understanding.