3 ms·
> That's a bit like saying FOSS is open source only if a copy of the programmers is applied with the code. Wait, what? You can build the FOSS app entirely fro
by tomComb 3y ago
> That's a bit like saying FOSS is open source only if a copy of the programmers is applied with the code.
Wait, what? You can build the FOSS app entirely from the source. You don’t need a copy of the programmer.
- JieJie 3y agoJust as you say, you do not need Llama's training data in order to build Llama from source, nor even to fine tune it. You don't need a copy of the training data. (edit to spell Llama correctly)
- KaiserPro 3y agoNo, you need llama's binary, you can;t know what its trained on because thats a secret or at least obfuscated. The currently LLM status is more akin to opensource plugins to some propriety system, like game modding.
- est31 3y agoYou can fine tune it, which gets you far, don't get me wrong. But you cannot study how major model changes to Llama or changes during the training process behave when you apply those changes from scratch.