3 ms·
On the second point, there's an uncensored version available and assorted trained-for-purpose derivatives of it.
by crooked-v 3y ago
On the second point, there's an uncensored version available and assorted trained-for-purpose derivatives of it.
- mistrial9 3y agolinks please!
- mschuster91 3y agoYou can run it on ollama: https://ollama.ai/blog/run-llama2-uncensored-locally https://ollama.ai/blog/run-llama2-uncensored-locally
- nomel 3y agoThese are not the uncensored models. It's a fine tune of the censored models [1]. > Filter refusals and bias from the dataset -> finetune the model -> release. The alignment tax should still exist, maybe doubly so. [1] https://erichartford.com/uncensored-models#heading-lets-get-down-to-business-uncensoring-wizardlm https://erichartford.com/uncensored-models#heading-lets-get-...
- kristianp 3y agoThe base model is uncensored. From a glance at your link, that is about uncensoring the conversational training set.
- nomel 3y agoI don't think so: https://erichartford.com/uncensored-models#heading-whats-an-uncensored-model https://erichartford.com/uncensored-models#heading-whats-an-... > Most of these models (for example, Alpaca, Vicuna, WizardLM, MPT-7B-Chat, Wizard-Vicuna, GPT4-X-Vicuna) have some sort of embedded alignment > The reason these models are aligned is that they are trained with data that was generated by ChatGPT, which itself is aligned by an alignment team at OpenAI.
- kristianp 3y agoMost of those are fine-tunes of the base model. The fine-tuning data is 'aligned'. The uncensored fine-tune training data is edited to remove the "I can't help you with that" responses.
- nomel 3y agoYes, as stated in my earlier comment: there's an alignment tax, and then almost certainly an un-alignment tax, on top of that, compared to the raw, unaligned/uncensored, models.
- mistrial9 3y agothat is interesting, but the "un-training" shown by EricH. is simply re-running some fine-tuning on the same public base model, regarding "refusals".. and it is expen$ive to do that, too.
- mholm 3y agoAre these uncensored or decensored? If rlhf removes intelligence at any rate, I wouldn’t expect that intelligence to come back with a tune that’s let’s it say curse words and talk about religions
- deleted 3y ago[deleted]
- qeternity 3y agoThe foundation model is not “censored”, it’s the RLHF’d “chat” versions that are. Meta released both.
- danielbln 3y agoThey are very much uncensored, give it a try yourself: `ollama run llama2-uncensored` [0] It will be happy to curse, talk about religions, help you cook illicit substances or do all sorts of other stuff. [0] https://ollama.ai/ https://ollama.ai/