2 ms·
Measuring Goodhart’s Law
- buscoquadnary 5y agoSounds likes the outcome of this measuring isn't such a great measure anymore.
- uoaei 5y agoThe irony is the point, I think.
- paulorlando 5y agoThanks for posting this. Would like to learn more detail on your work. I've been drawn to the topic by originally hearing about Goodhart's from developers, even though it interestingly originated with observations on UK's monetary policy. (I wrote a (non-math, non-AI) version to learn more about Goodhart's Law here: https://unintendedconsequenc.es/new-morality-of-attainment-goodharts-law/ https://unintendedconsequenc.es/new-morality-of-attainment-g...)
- dr_dshiv 5y agoWhat is best of n sampling? I didn’t follow. Is that like, which of these n images is best, and then turning that into a measure?
- alextp 5y agoChoose the top N according to the proxy objective and then use the real objective to choose the best out of those N candidates.
- jmalicki 5y agoThat was my initial understanding, which left me confused. But they're taking the top n according to the model, then taking the top according to the proxy, not actual, objective. This avoids the Winner's Curse problem of top model ranking with reasonable probability. They are then comparing this to the highest scoring actual preference.
- AlbertCory 5y agoI think the same thing applies to some biomarkers; cholesterol, for one. Cholesterol is an accepted biomarker for stroke & heart disease. Thus, Big Pharma can "prove" that lowering your cholesterol by M is worth N.n years on your life. Therefore, take our statins. Daily. Forever. I'm not buying it. That's optimizing the measure. "Exercise more & lose weight" is thought impossible for the average person, or at least, unlikely to be heeded, so give them a statin instead.
- deleted 5y ago[deleted]