> You know a burger tastes really good when you eat it, no benchmarks required. I'd say this is a good example of the opposite, where the problem is finding th

> You know a burger tastes really good when you eat it, no benchmarks required. I'd say this is a good example of the opposite, where the problem is finding the quantification of an ultimately subjective experience. Take three restaurant reviewers to a burger joint and you might end up with four different opinions. Benchmarks proliferate because many LLM domains defy easy, quantitative measurement, yet LLM development and deployment are so expensive that they need to be guided by independent and quantitative (even if not fully objective) measures.