22 ms·
The EuroLLM-9B model release is from Dec/2024, and scores just above random chance for benchmarks like MMLU-Pro (17.6%, random chance is 10%). Comparison with
by adt 1y ago
The EuroLLM-9B model release is from Dec/2024, and scores just above random chance for benchmarks like MMLU-Pro (17.6%, random chance is 10%).
Comparison with similar EU models + 600 other highlights:
https://lifearchitect.ai/models-table/ https://lifearchitect.ai/models-table/