3 ms·
The "coding benchmarks" like "SWE-verified" are actually of very low quality and the answer riddled with problems. Good Explainer: "The Disturbing Reality of A
by mentalgear 2y ago
The "coding benchmarks" like "SWE-verified" are actually of very low quality and the answer riddled with problems.
Good Explainer: "The Disturbing Reality of AI Coding"
https://www.youtube.com/watch?v=QnOc_kKKuac https://www.youtube.com/watch?v=QnOc_kKKuac