4 ms·
How does "overfitting is ok" violate information theory? How are hallucinations suggestive of overfitting? Overfitting is a tactical term, not a strategic one
by sdwr 2y ago
How does "overfitting is ok" violate information theory?
How are hallucinations suggestive of overfitting?
Overfitting is a tactical term, not a strategic one, and is heavily coupled to the specific implementation.
- AlotOfReading 2y agoI suspect they're trying to relate the pigeonhole principle to overparameterization, but those pieces don't really fit together into a coherent argument for me.
- genewitch 2y agoWhat is the difference between a strategy and a tactic?
- sdwr 2y agoStrategy is the big-picture plan, tactics are "in the moment" actions. Scamming seniors over the phone is a strategy, pretending to be their grandson is a tactic.