3 ms·
I assume you mean open weight models? I wish we had better open source models. It would make LLMs far less icky if we had nice clean open trained models. A brea
by draxil 8mo ago
I assume you mean open weight models? I wish we had better open source models. It would make LLMs far less icky if we had nice clean open trained models. A breakthrough on the cost of training would be nice.
- cmiles8 8mo agoFair clarification, yes.
- mike_hearn 8mo agoNemotron is genuinely open source at least at the smaller sizes. You can download the datasets.
- marci 8mo agoAlso everything from scratch by allen.ai. Weights, datasets, code, multiple checkpoints... I like their FlexOlmo concept.
- Yizahi 8mo agoWe really can't have open source LLM, because they are all based on the stolen IP, or stolen IP slightly laundered and under different title.
- harlanji 8mo agoI feel like an opt-in model built on AGPL code should output AGPL code. I'd put my work into that. Not the only option just an example. Every great project takes time to build. It's possible.
- BoredomIsFun 8mo agoHmm...no. These two things are orthogonal. Regardless, Olmo are opensource.
- seism 8mo agoCheck out Apertus, the publicly funded model from a research team that goes to great lengths to remove icky content.