4 ms·
Tops our benchmark in an unprecedented way. https://help.kagi.com/kagi/ai/llm-benchmark.html https://help.kagi.com/kagi/ai/llm-benchmark.html High quality, to
by freediver 2y ago
Tops our benchmark in an unprecedented way.
https://help.kagi.com/kagi/ai/llm-benchmark.html https://help.kagi.com/kagi/ai/llm-benchmark.html
High quality, to the point. Bit on the slow side. Indeed a very strong model.
Google is back in the game big time.
- aoeusnth1 2y agoIt should be in the "reasoning" category, right? (still topping the charts there)
- utopcell 2y agoThat is some wide gap!
- causal 2y agoRemarkable how few tokens it needed to get a much better score than other reasoning models. Any chance of contamination?
- 85392_school 2y agoIt makes me wonder how the token counting was implemented and if it missed the (not sent in API) reasoning.
- freediver 2y agoVaild concern, most likely thinking tokens were not counted due to API reporting changes.