3 ms·
Fitting a manifold to a bunch of samples does not allow you to understand what can happen in the universe. For example, if you train a regular diffusion model o
by uecker 1y ago
Fitting a manifold to a bunch of samples does not allow you to understand what can happen in the universe. For example, if you train a regular diffusion model on correct sudokus, it will produce sudokus with errors because it does not understand the rules.
- esafak 1y agoYou raise a good point for the diffusion case, which trains only on positive examples, but generally speaking negative examples will warp the manifold appropriately.
- uecker 1y agoSure, but you show a few correct examples to a human it will quickly pick up the correct rules. And this is understanding.