3 ms·
LLAMA is an open-weights model. I like this term, let's use that instead of open source.
by aerzen 2y ago
LLAMA is an open-weights model. I like this term, let's use that instead of open source.
- gowld 2y agoCan a human programmer edit the weights according to some semantics?
- sebastiennight 2y agoIt is possible to merge two fine-tunes of models from the same family by... wait for it... averaging or combining their weights[0]. I am still amazed that we can do that. [0]: https://arxiv.org/abs/2212.09849 https://arxiv.org/abs/2212.09849
- the8thbit 2y agoThis is absolutely wild.
- root_axis 2y agoYes. Using fine tuning.
- sitkack 2y agoYes, there is the concept of a "frakenmerge" and folks have also bolted on vision and audio models to LLMs.