3 ms·
The only known to me is LLaMA 2 to remove censorship using LoRA.
by treprinum 3y ago
The only known to me is LLaMA 2 to remove censorship using LoRA.
- Animats 3y agoHm. Why aren't those things all over the place?
- treprinum 3y agoThey kinda are, HuggingFace hub is already full of them. Most of them were released like 3-4 days ago so that might be a reason why you don't see them. I already put one of them into production.
- nickpsecurity 3y agoThe people that make them often post them or comment in the sub-Reddit below. I've linked to a search for uncensored models in there. Usernames of main people involved are faldore and The-Bloke. Most had Wizard Uncensored in their names. https://www.reddit.com/r/LocalLLaMA/search/?q=uncensored&restrict_sr=1 https://www.reddit.com/r/LocalLLaMA/search/?q=uncensored&res... People have posted comparisons showing it works pretty well. Some foundational models have enough censorship built in that they still try to resist it. You have to prompt those cleverly to do what you want them to do.
- fnordpiglet 3y agoThere are tons of them for other models, often Alpaca or LLaMA. This is a popular tool for finetuning Alpaca: https://github.com/tloen/alpaca-lora https://github.com/tloen/alpaca-lora
- treprinum 3y agoLLaMA or Alpaca aren't free outside research though, so it's better to focus on LLaMA 2.