3 ms·
> (let's not fight about semantics please) But what you dismiss as semantics is entirely relevant! You're upset that Microsoft and OpenAI gatekeep uncensored m
by orra 3y ago
> (let's not fight about semantics please)
But what you dismiss as semantics is entirely relevant! You're upset that Microsoft and OpenAI gatekeep uncensored models. But Llama 2 has similar content filters, no? And certainly a huge list of license restrictions.
I'm glad the actual open source models are constantly improving.
- selfhoster11 3y agoLlama 2, the base model, does not have any content filters or alignment built in. Llama 2 chat, the model creates by taking the Llama 2 base model and fine-tuning it with a specialised RLHF dataset, does have "filters" (pre-loaded responses more likely to be generated for certain topics and requests). In practice, on smaller models these are able to be bypassed with some prompt engineering. I expect uncensored chat models, created on top of the uncensored Llama 2 base models, to become available in a week or two at most (from the community, obviously, not from Facebook), if there are not already some available.
- orra 3y agoThank you for the correction. I still maintain the license is obnoxious, but clearly I was wrong about the models themselves.
- selfhoster11 3y agoOh yes, the license is definitely not great. But it's also much better than it could have been, and at least gives official assent for the model to be used for the majority of commercial and non-commercial purposes, which is better than what we had with the first leaked Llama.
- awesomeMilou 3y agoLlama2's license agreement explicitly forbids training novel models based on Llama2's output. > v. You will not use the Llama Materials or any output or results of the Llama Materials to improve any other large language model (excluding Llama 2 or derivative works thereof). https://ai.meta.com/resources/models-and-libraries/llama-downloads/ https://ai.meta.com/resources/models-and-libraries/llama-dow...