4 ms·
They're on Hugging Face. Interestingly enough they don't compare it against Mistral 7B. https://huggingface.co/allenai/OLMo-7B https://huggingface.co/allenai/O
by mysteria 3y ago
They're on Hugging Face. Interestingly enough they don't compare it against Mistral 7B.
https://huggingface.co/allenai/OLMo-7B https://huggingface.co/allenai/OLMo-7B
- polygamous_bat 3y agoI commented this somewhere else, but word in the ether is that OLMo is not actually that good of a model given its size and compute budget. I am not entirely sure why, and it’s still good to have the full recipe for at least one model out in the open, but the current OLMo definitely is a cautionary tale for people training their own model.