3 ms·

I think there are some similarities between Goodhart’s law and overfitting, but I don’t think the lesson or underlying mechanism or model is the same. Crudely

by epgui 4y ago

I think there are some similarities between Goodhart’s law and overfitting, but I don’t think the lesson or underlying mechanism or model is the same. Crudely speaking, Goodhart’s law is a reflection of the system reacting to an intervention (ie.: dynamic feedback loops) and that just has nothing to do with overfitting.

visarga 4y ago
Training a neural net is a dynamic feedback loop too. Back-propagation is the feedback phase.
- epgui 4y ago
  Not in the same sense whatsoever. Training a neural net, backpropagation or not, doesn't affect the data. It's basically just some variation of / remix of a linear regression.
  - visarga 4y ago
    Yes, for that you need RL. An environment beats a fixed, even large, training set.
    - epgui 4y ago
      I think we're probably using different words to make the same distinction, and in any case the underlying mechanism is very different.