4 ms·
Goodhart’s Law in reverse, what can’t be gamed gets rejected.
by Jimmc414 6mo ago
Goodhart’s Law in reverse, what can’t be gamed gets rejected.
- cbg0 6mo agoSWE-bench verified was created in collaboration with OpenAI. It's also an open dataset so prone to contamination, meaning it can be gamed.
- stephen_cagle 6mo agoYou've almost buffer overrun Goodhart's Law into the https://en.wikipedia.org/wiki/McNamara_fallacy https://en.wikipedia.org/wiki/McNamara_fallacy . :]