3 ms·
> I felt a bit crazy pushing back on this--surely, using more variables and more parameters will make the model fit historical data more closely, and a model wh
by thaumasiotes 4y ago
> I felt a bit crazy pushing back on this--surely, using more variables and more parameters will make the model fit historical data more closely, and a model which fits historical data more closely will fit future data more closely, and a model which fits future data more closely will be more useful?
> Explaining why this is wrong is really hard.
Seems straightforward. Points 1 and 3 are correct; point 2 is false.
- klodolph 4y agoPoints 1 and 2 are both wrong also. Statistics is not intuitive.
- thaumasiotes 4y agoPoint 1 isn't wrong; it's correct. There's a reason the name for this problem is "overfitting".
- klodolph 4y agoYeah, it sounds like you’re assuming two things things here which are often (or usually) wrong: 1. No cross-validation, and 2. You have the ability to solve for additional parameters without losing accuracy. Statistics is not intuitive.