4 ms·
The best model, Unnatural Code Llama, is not released. Likely because it's trained on GPT4 based data, and might violate OpenAI TOS, because as per the "Unnatur
by Palmik 3y ago
The best model, Unnatural Code Llama, is not released. Likely because it's trained on GPT4 based data, and might violate OpenAI TOS, because as per the "Unnatural" paper [1], the "unnatural" data is generated with the help of some LLM -- and you would want to use as good of an LLM as possible.
[1] https://arxiv.org/pdf/2212.09689.pdf https://arxiv.org/pdf/2212.09689.pdf
- redox99 3y agoThe good thing is that if it's only finetuned on 15k instructions, we should see a community made model like that very soon.