3 ms·
"Opus 4.5 feels to me like" The article is fine opinion but at what point are we going to either: a) establish benchmarks that make sense and are reliable, or
by Papazsazsa 9mo ago
"Opus 4.5 feels to me like"
The article is fine opinion but at what point are we going to either:
a) establish benchmarks that make sense and are reliable, or
b) stop with the hypecycle stuff?
- NewsaHackO 9mo ago>establish benchmarks that make sense and are reliable How aren't current LLM coding benchmarks reliable?
- Papazsazsa 9mo agoThey're manipulated.
- NewsaHackO 9mo agoUnless you are going to be more specific, that criticism applies to all benchmarks that are connected to a positive gain, not just AI coding benchmarks.
- cardine 9mo ago> make sense and are reliable If you can figure out how to create benchmarks that make sense, are reliable, correlate strongly to business goals, and don't get immediately saturated or contorted once known, you are well on your way to becoming a billionaire.