4 ms·
Better a downloadable blob than a non-downloadable one
by raverbashing 2y ago
Better a downloadable blob than a non-downloadable one
- kortilla 2y agoCool, that’s not open source though. That’s like a chef giving you chicken instead of beef and calling it vegetarian.
- ineedasername 2y agoI’d say it’s more like eating Chicken Cordon Bleu and then asking the chef for a recipe, who replies, “Certainly! Step 1) Acquire Chicken Cordon Bleu, preferably cooked. Step 2) if uncooked, cook. Otherwise, consume
- aiono 2y agoParent doesn't argue about that. How is this relevant?
- nicce 2y agoThis is the problem - we accept this approach and then they don't have to do any effort to correctly publish them in open means.
- frabcus 2y agoNo, it's not, as it means nobody is pushing for actually open models. A truly open model has open code that gathers pre-training data, open pre-training data, open RLHF data, open RLAIF data generated from its open constitution and so on. The binary blob is the last thing I'd want - as a heavy user of LLMs I'm actually more interested in the detail of what all training data is in full, than I am the binary blob.
- tuananh 2y agoIBM Granite is actually open https://www.ibm.com/granite https://www.ibm.com/granite
- __m 2y agoat least for the pre-training data there are some open source torrent clients [0]. [0] https://news.ycombinator.com/item?id=42971446 https://news.ycombinator.com/item?id=42971446
- ks2048 2y agoHere's a real open one: https://allenai.org/olmo https://allenai.org/olmo