4 ms·
> Apache 2 Isn't the original GPLv3[0]? [0]: https://github.com/facebookresearch/llama/blob/main/LICENSE https://github.com/facebookresearch/llama/blob/main/L
by kristjansson 4y ago
> Apache 2
Isn't the original GPLv3[0]?
[0]: https://github.com/facebookresearch/llama/blob/main/LICENSE https://github.com/facebookresearch/llama/blob/main/LICENSE
- lantiga 4y agoCorrect, the original is GPL 3. To produce this implementation from the LLaMA paper we started from github.com/karpathy/nanoGPT, the LLaMA architecture is really similar to GPT. For instance we added rotary positional encoding starting from the original RoPE repo published with the paper. We finally ran the original model to make sure the two models were numerically.