8 ms·
Made a Ask HN, but screwed it up by editing the text. Anyway, good ideas/tools for evaluating LLMs ? Naturally, as a Dane, I am moving away from Claude, but I’
by pseudony 9mo ago
Made a Ask HN, but screwed it up by editing the text.
Anyway, good ideas/tools for evaluating LLMs ?
Naturally, as a Dane, I am moving away from Claude, but I’d like more than a gut feel about how much I may have given up to do so.
- istanbulbebesi 9mo agoJust go for Qwen or Deepseek. They are both very good.
- microtonal 9mo agoOr Mistral, it is French and has been great for my day to day queries (haven't tried for programming yet).
- sillyfluke 9mo agoMistral has made a pivot from small model focus to large model focus by getting into bed with Microsoft. I don't know how sticky their deals are but, taking a quick look at recent Microsoft press releases, Mistral still seems to be prioritizing releases on Azure.
- microtonal 9mo agoDon't let perfect be the enemy of good. They are currently the most (if only) serious non-US Western player.
- mcbetz 9mo agoYou might benefit from LMArena's Leaderboard. It does not have Danish (yet), but German and English evaluation might help: https://lmarena.ai/de/leaderboard/text/german https://lmarena.ai/de/leaderboard/text/german Openrouter.ai shows the location of providers, you can find just a few European services, but also Singaporean and Canadian. Unfortunately, I could not find a way to filter easily.