A bit apples to oranges, as they compare against raw LLaMA 65B, not the instruction tuned variants, or the now SOTA finetuned Falcon 40B[1]. 1: https://hugging

A bit apples to oranges, as they compare against raw LLaMA 65B, not the instruction tuned variants, or the now SOTA finetuned Falcon 40B[1]. 1: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb... Still, a competitive multilingual model is very cool.