11 ms·
The name for it is ablation - precise removal of parts of the model. Not abliteration as it is not obliteration. Even as I write this the ‘abliterated’ word is
by larodi 3mo ago
The name for it is ablation - precise removal of parts of the model. Not abliteration as it is not obliteration.
Even as I write this the ‘abliterated’ word is denoted a typo. Does it not at your end?
- 3abiton 3mo agoI miss the days of 4changpt.
- gliptic 3mo agoThe name for it _is_ abliterate. It's a portmanteau of ablate and obliterate.
- larodi 3mo agoNo tis not. The terminology has medical origins, and it is very much this https://en.wikipedia.org/wiki/Ablation https://en.wikipedia.org/wiki/Ablation "Ablation (Latin: ablatio – removal) is the removal or destruction of something from an object by vaporization, chipping, erosive processes, or by other means." which is what one does to the model during... well, ablation.
- gliptic 3mo agoExcept we're talking about a _different_ word, a word that was _coined_ as a portmanteau of the word you're referring to and another word.
- larodi 3mo agoRillii ease eat? R U sure https://en.wikipedia.org/wiki/Ablation_(artificial_intelligence) https://en.wikipedia.org/wiki/Ablation_(artificial_intellige... Have you read some (any) actual papers from the word this all and LLMs are? Well here some: https://arxiv.org/abs/1901.08644 https://arxiv.org/abs/1901.08644 Tis ablation ablation and ablation everywhere save for some kid’s fav. model names and their X pals.
- eggsyntax 3mo agoPapers using the term in their title or abstract: https://arxiv.org/search/cs?query=abliteration&searchtype=all&abstracts=show&order=-announced_date_first&size=50 https://arxiv.org/search/cs?query=abliteration&searchtype=al... Note that they're all talking about the same technique, namely applying ablation specifically to the refusal vector as described in https://arxiv.org/abs/2406.11717 https://arxiv.org/abs/2406.11717. I really recommend letting this one go.
- gliptic 3mo agoThe very wikipedia page you're linking says: > The term abliteration has been coined for the process of using ablation to uncensor large language models by modifying internal functions to completely eliminate refusal behaviors while preserving the remaining functions of the model. The word is a portmanteau that combines the words ablation and obliteration. So are you dropping this now?
- zargon 3mo agoThe name is abliterate. It's a specific method of ablation.
- SonOfLilit 3mo agohttps://github.com/NousResearch/llm-abliteration https://github.com/NousResearch/llm-abliteration
- larodi 3mo agowell see my other comment. with all due respect to Teknium, perhaps he misspelled it.
- gliptic 3mo agohttps://en.wiktionary.org/wiki/abliterate https://en.wiktionary.org/wiki/abliterate
- larodi 3mo agofirst version... curprev 22:29, 29 May 2025 ZeevoX talk contribs 2,320 bytes +2,320 Create page for "abliterate" Tag: added link not very credible.
- SonOfLilit 3mo agoI wnt and read your other comments. Except for the initial comment, they were aggressive and sometimes disrespectful claims that "the word is spelled ablation, here are some papers that use it" in response to people saying "yes, we know what ablation means, but GP is intentionally using a separate word 'abliteration' that is the accepted word for the kind of ablation he's talking about, see links to respectable sources using or defining it". I downvoted them because I feel the discussion would be more valuable and feel nicer to read without them, and you could just read any of the offered links before responding and save the trouble.
- 3mo ago