3 ms·

Not only are there many American open weight models as others have mentioned, but Americans are the only ones doing actual open source models [0]. Not just dis

by petcat 2mo ago

Not only are there many American open weight models as others have mentioned, but Americans are the only ones doing actual open source models [0]. Not just distributing binary blobs and calling them "open". [0] https://allenai.org/ https://allenai.org/

deleted 2mo ago
[deleted]
andy99 2mo ago
There aren’t any relevant ones. I think it should be an important goal of these projects (unless there is a clear conflicting goal) to make models people actually talk about and use. There is no question this is true for the Chinese open LLMs. GPT-OSS had a small moment of interest, arguably it was a success as an open model for a while but it’s not relevant now. The early llamas were probably the most successful for their time. Allenai / olmo was never relevant as far as I can tell. It’s not super helpful, especially as a sovereign government initiative to build an also-ran, they should be going for real relevance. By releasing models with open-weights, DOE seeks to galvanize the scientific and AI communities around shared infrastructure for science: enabling new workflows in materials discovery, energy systems, earth systems modeling, fusion, biology, high-energy physics, and beyond. This only works if people have a good reason to use it.
fulafel 2mo ago
It is not the case that the only rebuildable-from-source open source models are from the USA. There's at least BLOOM, Apertus and OpenEuroLLM, and I'm sure there are many more.
colinhb 2mo ago
There are many open source (not just open weight) non-US models - some of the more notable ones: - Soofi S, DE, ~32B - Apertus 1.5, CH, ~32B - EuroLLM-22B, EU, ~22B - LLM-jp-3, JP, ~172B - K2-65B, UAE, ~65B Soofi S and Apertus 1.5 outperform or are at least comparable to Ai2 depending on benchmarks.
Ohentis 2mo ago
I never understood this criticism. Any good data set contains copyrighted data so any "open source" model will be crappy, most of the price is in training these models (if you have the compute, why would an "open source" model be helpful anyways), and you can already modify a model from just it's weights. Why should we want an "open source" model. Just give me the weights.

by petcat 2mo ago

deleted 2mo ago

[deleted]

andy99 2mo ago

There aren’t any relevant ones. I think it should be an important goal of these projects (unless there is a clear conflicting goal) to make models people actually talk about and use. There is no question this is true for the Chinese open LLMs. GPT-OSS had a small moment of interest, arguably it was a success as an open model for a while but it’s not relevant now. The early llamas were probably the most successful for their time. Allenai / olmo was never relevant as far as I can tell. It’s not super helpful, especially as a sovereign government initiative to build an also-ran, they should be going for real relevance. By releasing models with open-weights, DOE seeks to galvanize the scientific and AI communities around shared infrastructure for science: enabling new workflows in materials discovery, energy systems, earth systems modeling, fusion, biology, high-energy physics, and beyond. This only works if people have a good reason to use it.

fulafel 2mo ago

It is not the case that the only rebuildable-from-source open source models are from the USA. There's at least BLOOM, Apertus and OpenEuroLLM, and I'm sure there are many more.

colinhb 2mo ago

There are many open source (not just open weight) non-US models - some of the more notable ones: - Soofi S, DE, ~32B - Apertus 1.5, CH, ~32B - EuroLLM-22B, EU, ~22B - LLM-jp-3, JP, ~172B - K2-65B, UAE, ~65B Soofi S and Apertus 1.5 outperform or are at least comparable to Ai2 depending on benchmarks.

Ohentis 2mo ago

I never understood this criticism. Any good data set contains copyrighted data so any "open source" model will be crappy, most of the price is in training these models (if you have the compute, why would an "open source" model be helpful anyways), and you can already modify a model from just it's weights. Why should we want an "open source" model. Just give me the weights.