3 ms·
I assume you mean open weight models? I wish we had better open source models. It would make LLMs far less icky if we had nice clean open trained models. A brea
by draxil 6mo ago
I assume you mean open weight models? I wish we had better open source models. It would make LLMs far less icky if we had nice clean open trained models. A breakthrough on the cost of training would be nice.
- cmiles8 6mo agoFair clarification, yes.
- mike_hearn 6mo agoNemotron is genuinely open source at least at the smaller sizes. You can download the datasets.
- marci 6mo agoAlso everything from scratch by allen.ai. Weights, datasets, code, multiple checkpoints... I like their FlexOlmo concept.
- Yizahi 6mo agoWe really can't have open source LLM, because they are all based on the stolen IP, or stolen IP slightly laundered and under different title.
- harlanji 6mo agoI feel like an opt-in model built on AGPL code should output AGPL code. I'd put my work into that. Not the only option just an example. Every great project takes time to build. It's possible.
- BoredomIsFun 6mo agoHmm...no. These two things are orthogonal. Regardless, Olmo are opensource.
- seism 6mo agoCheck out Apertus, the publicly funded model from a research team that goes to great lengths to remove icky content.