Benchmarking papers are borderline useless. Goodhart’s law is a thing when a measure becomes a target it ceases to be a good measure. That’s why I keep coming b

Benchmarking papers are borderline useless. Goodhart’s law is a thing when a measure becomes a target it ceases to be a good measure. That’s why I keep coming back to GPT4. It has the most “magic” and “mind reading ability”. Try to quantify that.