If you're interested in truly open source LLMs, I've been playing CroissantLLM, a bilingual French/English LM; it's smaller than OLMo (1.3b vs 7b, so not in the

If you're interested in truly open source LLMs, I've been playing CroissantLLM, a bilingual French/English LM; it's smaller than OLMo (1.3b vs 7b, so not in the same category), and has checkpoints, training code, logs, datasets, and a new benchmark fully open source: Paper: https://arxiv.org/abs/2402.00786 https://arxiv.org/abs/2402.00786 Announce: https://huggingface.co/blog/manu/croissant-llm-blog https://huggingface.co/blog/manu/croissant-llm-blog