3 ms·
Leaning the manifold is understanding. Reasoning, which takes place on the manifold, is applying that understanding.
by esafak 1y ago
Leaning the manifold is understanding. Reasoning, which takes place on the manifold, is applying that understanding.
- uecker 1y agoI am not sure what you definition of "understanding" is that you apply here.
- esafak 1y agoI mean understanding physics and the universe of natural possibilities; what can happen. Then comes why.
- uecker 1y agoFitting a manifold to a bunch of samples does not allow you to understand what can happen in the universe. For example, if you train a regular diffusion model on correct sudokus, it will produce sudokus with errors because it does not understand the rules.
- esafak 1y agoYou raise a good point for the diffusion case, which trains only on positive examples, but generally speaking negative examples will warp the manifold appropriately.
- uecker 1y agoSure, but you show a few correct examples to a human it will quickly pick up the correct rules. And this is understanding.