comp_raccoon

5 ms·

1.
by comp_raccoon 11mo ago
Olmo author here! Your are absolutely spot on on > It was impossible for me to actually fact-check any of the claims in the response based on the matched training data. this is true! the point of OlmoTrace is to show that even the smalle
2.
by comp_raccoon 11mo ago
Olmo author here… would be nice to have some more competition!! I don’t like that we are so lonely either. We are competitive with open weights models in general, just a couple points behind best Qwen. Fully open models are important for re
3.
by comp_raccoon 11mo ago
Olmo author here, but I can help! First release of Qwen 3 left a lot of performance on the table bc they had some challenges balancing thinking and non-thinking modes. VL series has refreshed posttrain, so they are much better!
4.
by comp_raccoon 11mo ago
Olmo author here! Qwenmodels are in general amazing, but 30B is v fast cuz it’s an MoE. MoEs very much on the roadmap for next Olmo.
5.
by comp_raccoon 11mo ago
Olmo author here! we release all training data and all our training scripts, plus intermediate checkpoints, so you could take a checkpoint, reproduce a few steps on the training data, and check if loss matches. it’s no cryptography proof, a
6.
by comp_raccoon 11mo ago
Olmo researcher here. The point of OlmoTrace is not no attribute the entire response to one document in the training data—that’s not how language models “acquire” knowledge, and finding a single or few documents as support for an answer is
7.
by comp_raccoon 2y ago
This is correct! we wanted to show that you can use PixMo dataset and our training code to improve any open model, not just ours!
8.
by comp_raccoon 2y ago
google image APIs are not great, yeah it’s only for demo, though—checkpoints on huggingface are uncensored.
9.
by comp_raccoon 2y ago
it’s coming! just takes a bit more time to properly release it.
10.
OLMoE and the hidden simplicity in training better foundation models(interconnects.ai)
3 points by comp_raccoon 2y ago|0 comments
11.
by comp_raccoon 3y ago
they have a technical report coming! knowing the team, they will do a great job disclosing as much as possible.