4 ms·
It’s incredible how fast these models are getting better. I thought for sure a wall would be hit, but these numbers smashes previous benchmarks. Anyone have any
by czhu12 8mo ago
It’s incredible how fast these models are getting better. I thought for sure a wall would be hit, but these numbers smashes previous benchmarks. Anyone have any idea what the big unlock that people are finding now?
- fsh 8mo agoCompanies are optimizing for all the big benchmarks. This is why there is so little correlation between benchmark performance and real world performance now.
- czhu12 8mo agoIsn’t there? I mean, Claude code has been my biggest usecase and it basically one shots everything now
- fsh 8mo agoYes, LLMs have become extremely good at coding (not software engineer though). But try using them for anything original that cannot be adapted from GitHub and Stack Overflow. I haven't seen much improvement at all at such tasks.
- dboreham 8mo agoStrongly disagree with this. And I'm going to provide as much evidence as you did.
- WarmWash 8mo agoNo shot, their classic engineering ability has exploded too. The amount of information available online about optics is probably <0.001% of what is available for software, and they can just breeze through modeling solutions. A year ago was immediate face-planting. The gains are likely coming from exactly where they say they are coming from - scaling compute.