3 ms·
Languages, sizes, and degrees of open-ness.
by refulgentis 3y ago
Languages, sizes, and degrees of open-ness.
- chuckhend 3y agoThere's some more commentary on their open-ness in this blog too https://www.interconnects.ai/p/olmo https://www.interconnects.ai/p/olmo
- dwagnerkc 3y agoThat post also very helpfully links to another paper they published alongside the OLMo paper just on the dataset. Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research https://arxiv.org/abs/2402.00159 https://arxiv.org/abs/2402.00159