3 ms·
These are not the uncensored models. It's a fine tune of the censored models [1]. > Filter refusals and bias from the dataset -> finetune the model -> release.
by nomel 3y ago
These are not the uncensored models. It's a fine tune of the censored models [1].
> Filter refusals and bias from the dataset -> finetune the model -> release.
The alignment tax should still exist, maybe doubly so.
[1] https://erichartford.com/uncensored-models#heading-lets-get-down-to-business-uncensoring-wizardlm https://erichartford.com/uncensored-models#heading-lets-get-...
- kristianp 3y agoThe base model is uncensored. From a glance at your link, that is about uncensoring the conversational training set.
- nomel 3y agoI don't think so: https://erichartford.com/uncensored-models#heading-whats-an-uncensored-model https://erichartford.com/uncensored-models#heading-whats-an-... > Most of these models (for example, Alpaca, Vicuna, WizardLM, MPT-7B-Chat, Wizard-Vicuna, GPT4-X-Vicuna) have some sort of embedded alignment > The reason these models are aligned is that they are trained with data that was generated by ChatGPT, which itself is aligned by an alignment team at OpenAI.
- kristianp 3y agoMost of those are fine-tunes of the base model. The fine-tuning data is 'aligned'. The uncensored fine-tune training data is edited to remove the "I can't help you with that" responses.
- nomel 3y agoYes, as stated in my earlier comment: there's an alignment tax, and then almost certainly an un-alignment tax, on top of that, compared to the raw, unaligned/uncensored, models.