3 ms·
No, it's not, as it means nobody is pushing for actually open models. A truly open model has open code that gathers pre-training data, open pre-training data,
by frabcus 2y ago
No, it's not, as it means nobody is pushing for actually open models.
A truly open model has open code that gathers pre-training data, open pre-training data, open RLHF data, open RLAIF data generated from its open constitution and so on.
The binary blob is the last thing I'd want - as a heavy user of LLMs I'm actually more interested in the detail of what all training data is in full, than I am the binary blob.
- tuananh 2y agoIBM Granite is actually open https://www.ibm.com/granite https://www.ibm.com/granite
- __m 2y agoat least for the pre-training data there are some open source torrent clients [0]. [0] https://news.ycombinator.com/item?id=42971446 https://news.ycombinator.com/item?id=42971446
- ks2048 2y agoHere's a real open one: https://allenai.org/olmo https://allenai.org/olmo