3 ms·
I distrust those benchmarks after working with sonnet for half a year now. Many OpenAI models beat Sonnet on paper. This seems to be the case because it's stren
by razemio 2y ago
I distrust those benchmarks after working with sonnet for half a year now. Many OpenAI models beat Sonnet on paper. This seems to be the case because it's strength (agent, visual, caching) aren't being used, I guess? Otherwise there is no explanation why it's not constantly on top. I have tried so many times to use other models for various tasks, not only coding. The only thing where OpenAI accelerates is analytic tasks at a much higher price. Everything else sonnet works for me the best and Gemini Flash 2.0 for cost effective and latency relevant tasks.
In practice this perception of mine seems to be valid: https://openrouter.ai/models?order=top-weekly https://openrouter.ai/models?order=top-weekly
The same with this model. It claims to be good at coding but it seriously isn't compared to sonnet. Funny enough it isn't being tested against.
- esperent 2y ago> In practice this perception of mine seems to be valid: >https://openrouter.ai/models https://openrouter.ai/models According to your link, there's two providers (Chutes and Targon) offeri Deepseek R1 API access completely free of charge. Is that true? Can't see any info about usage limits. Is that
- razemio 2y agoThat is true and it works. Response times however are worse compared to the paid ones. If this is not a concern it works really well.