3 ms·
There's a version of Yi 34B (the original, not this newer "chat" constrained model) retrained without censorship. The 2.2 version has some additional training o
by fancy_pantser 3y ago
There's a version of Yi 34B (the original, not this newer "chat" constrained model) retrained without censorship. The 2.2 version has some additional training on longer chat contexts (sponsored by a16z).
https://huggingface.co/ehartford/dolphin-2_2-yi-34b https://huggingface.co/ehartford/dolphin-2_2-yi-34b
> New in 2.2 is conversation and empathy. With an infusion of curated Samantha and WizardLM DNA, Dolphin can now give you personal advice and will care about your feelings, and with extra training in long multi-turn conversation.
> This model is uncensored. I have filtered the dataset to remove alignment and bias. This makes the model more compliant. You are advised to implement your own alignment layer before exposing the model as a service. It will be highly compliant to any requests, even unethical ones.
In tests, this model will follow instructions well (e.g. writing a dark, gory horror film script), but feels more "unlocked" than actually "good" at those uncensored topics. If you want a model that's specifically trained with the dirty stuff that's normally filtered out of training corpora, try something like Xwin-MLewd-13B-V0.2.