2 ms·
You can take any Mistral 7B model or fine-tune and use this adapter to unalign it. https://huggingface.co/Hellisotherpeople/toxic-dpo-v2-mistral7b-lora https:/
by Der_Einzige 3y ago
You can take any Mistral 7B model or fine-tune and use this adapter to unalign it.
https://huggingface.co/Hellisotherpeople/toxic-dpo-v2-mistral7b-lora https://huggingface.co/Hellisotherpeople/toxic-dpo-v2-mistra...
- vicktorium 3y agoi guess OP meant "give me a link to the ui" or something. most people don't care/want to finetune. they want their model in a cute and easy interface.
- Eisenstein 3y agoNo need to fine tune; if you are running a local model just change the system prompt. * https://imgur.com/jHlcd2D.jpg https://imgur.com/jHlcd2D.jpg Warning, link is NSFW, though all it is is a screenshot of my terminal showing the prompt and the output when I loaded mistral-7b and asked it to write an erotic story.
- Der_Einzige 3y agoYes there is indeed a reason to fine-tune. The linked lora will make the model even less likely to refuse than otherwise. Mistral might be willing to do erotica sometimes, but it's often still trying to be "ethical" and not do "immoral" things.
- Eisenstein 3y agoGive me a prompt that won't work for you on Mistral.