3 ms·
I'm wondering as well. Here in open llm leaderboard there is only preview. Better than deepseek-ai/DeepSeek-R1-Distill-Qwen-32B but surprisingly worse than deep
by pzo 2y ago
I'm wondering as well. Here in open llm leaderboard there is only preview. Better than deepseek-ai/DeepSeek-R1-Distill-Qwen-32B but surprisingly worse than deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
in Open LLM leaderboard overall this model is ranked quite low at 660:
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?columns=rank%2Cmodel.type_icon%2Cid%2Cmodel.average_score%2Cevaluations.ifeval.normalized_score%2Cevaluations.bbh.normalized_score%2Cevaluations.math.normalized_score%2Cevaluations.gpqa.normalized_score%2Cevaluations.musr.normalized_score%2Cevaluations.mmlu_pro.normalized_score%2Cmetadata.co2_cost%2Cmetadata.params_billions%2Cmetadata.hub_license&official=true¶ms=7%2C65&pinned=Qwen%2FQwQ-32B-Preview_bfloat16_1032e81cb936c486aae1d33da75b2fbcd5deed4a_True%2Cdeepseek-ai%2FDeepSeek-R1-Distill-Qwen-32B_bfloat16_4569fd730224ec487752bd4954399c6e18bf3aa6_True%2Cdeepseek-ai%2FDeepSeek-R1-Distill-Qwen-14B_bfloat16_c79f47acaf303faabb7133b4b7b76f24231f2c8d_False https://huggingface.co/spaces/open-llm-leaderboard/open_llm_...