2 ms·
It appears that they reused a lot of the data preparation provided by the AllenAI team: https://github.com/allenai/OLMoE https://github.com/allenai/OLMoE http
by ogrisel 2y ago
It appears that they reused a lot of the data preparation provided by the AllenAI team:
https://github.com/allenai/OLMoE https://github.com/allenai/OLMoE
https://github.com/allenai/dolma https://github.com/allenai/dolma
https://github.com/AMD-AIG-AIMA/Instella https://github.com/AMD-AIG-AIMA/Instella