3 ms·
Super weird benchmarks
by gyudin 1y ago
Super weird benchmarks
- avereveard 1y agofrom what I gather it's finetuned to use OpenHand specifically so shows value on thsoe benchmark that target a whole system as a blackbox (i.e. agent + llm) more than directly target the llm input/outputs
- amarcheschi 1y agoYup the 1st comment says this https://www.reddit.com/r/LocalLLaMA/comments/1kryybf/mistralaidevstralsmall2505_hugging_face/ https://www.reddit.com/r/LocalLLaMA/comments/1kryybf/mistral...