3 ms·
>establish benchmarks that make sense and are reliable How aren't current LLM coding benchmarks reliable?
by NewsaHackO 10mo ago
>establish benchmarks that make sense and are reliable
How aren't current LLM coding benchmarks reliable?
- Papazsazsa 10mo agoThey're manipulated.
- NewsaHackO 10mo agoUnless you are going to be more specific, that criticism applies to all benchmarks that are connected to a positive gain, not just AI coding benchmarks.