2 ms·
is anyone doing online reviews of model performance ? (I know artificial analysis does some work on infrastructure and has an intelligence index)
by htrp 1y ago
is anyone doing online reviews of model performance ? (I know artificial analysis does some work on infrastructure and has an intelligence index)
- reckless 1y agoThe aggregate picture only tells you so much. Sites like simonwillison.net/2025/jul/ and channels like https://www.youtube.com/@aiexplained-official https://www.youtube.com/@aiexplained-official also cover new model releases pretty quickly for some "out of the box thinking/reasoning" evaluations. For me and my usage I can really only tell if I start using the new model for tasks I actually use them for. My personal benchmark andrew.ginns.uk/merbench has full code and data on GitHub if you want a staring point!
- Eupolemos 1y agoYeah, GosuCoder is interesting. https://youtu.be/064VC2gFIGY?si=l0LVtUttVrbiBZ3K https://youtu.be/064VC2gFIGY?si=l0LVtUttVrbiBZ3K