5 ms·
> there's an uncensored model that you can run locally with llama.cpp Correction: There's tens of thousands of them. They're easy to create, which is why ever
by chmod775 3mo ago
> there's an uncensored model that you can run locally with llama.cpp
Correction: There's tens of thousands of them. They're easy to create, which is why everyone publishes their own.
Just put "uncensored", "abliterated", or "heretic" into search on huggingface/ollama/etc and pick any them. Fair warning: most aren't very good, essentially lobotomized, and totally broken if you enable thinking.
- desterothx 3mo agointeresting, I haven't played with any of them yet, but i thought the point of orthogonalizing the weights towards the restriction vector was that there is no loss in capability while removing guardrails. Does it affect other parts of the RL alignment too?
- fy20 3mo agoThe claims by the creators are it doesn't in a major way. I have a uncensored Gemma 4 I run on my Mac. Just for testing out, I haven't found any need for it... yet.
- embedding-shape 3mo ago> the point of orthogonalizing the weights towards the restriction vector was that there is no loss in capability while removing guardrails That is surely the point, most of the "uncensored" weights released for free on HuggingFace aren't being very successful at this. There is a stark difference in output quality between the official weights and all these "uncensored" variants that appears days afterwards.
- larodi 3mo agoThe name for it is ablation - precise removal of parts of the model. Not abliteration as it is not obliteration. Even as I write this the ‘abliterated’ word is denoted a typo. Does it not at your end?
- 3abiton 3mo agoI miss the days of 4changpt.
- gliptic 3mo agoThe name for it _is_ abliterate. It's a portmanteau of ablate and obliterate.
- larodi 2mo agoNo tis not. The terminology has medical origins, and it is very much this https://en.wikipedia.org/wiki/Ablation https://en.wikipedia.org/wiki/Ablation "Ablation (Latin: ablatio – removal) is the removal or destruction of something from an object by vaporization, chipping, erosive processes, or by other means." which is what one does to the model during... well, ablation.
- gliptic 2mo agoExcept we're talking about a _different_ word, a word that was _coined_ as a portmanteau of the word you're referring to and another word.
- larodi 2mo agoRillii ease eat? R U sure https://en.wikipedia.org/wiki/Ablation_(artificial_intelligence) https://en.wikipedia.org/wiki/Ablation_(artificial_intellige... Have you read some (any) actual papers from the word this all and LLMs are? Well here some: https://arxiv.org/abs/1901.08644 https://arxiv.org/abs/1901.08644 Tis ablation ablation and ablation everywhere save for some kid’s fav. model names and their X pals.
- eggsyntax 2mo agoPapers using the term in their title or abstract: https://arxiv.org/search/cs?query=abliteration&searchtype=all&abstracts=show&order=-announced_date_first&size=50 https://arxiv.org/search/cs?query=abliteration&searchtype=al... Note that they're all talking about the same technique, namely applying ablation specifically to the refusal vector as described in https://arxiv.org/abs/2406.11717 https://arxiv.org/abs/2406.11717. I really recommend letting this one go.
- Scaled 3mo agoIn my own tests, the abliterated models perform equivalently to the same version in an apples-to-apples comparison (if you compare same quantization). Thinking is working also. The main difference is I don't get annoying prompt refusals (otherwise common due to my work on 18+ related projects). However, it's local quantized models so they're not anywhere near frontier quality.