3 ms·
No tis not. The terminology has medical origins, and it is very much this https://en.wikipedia.org/wiki/Ablation https://en.wikipedia.org/wiki/Ablation "Ablat
by larodi 3mo ago
No tis not. The terminology has medical origins, and it is very much this
https://en.wikipedia.org/wiki/Ablation https://en.wikipedia.org/wiki/Ablation
"Ablation (Latin: ablatio – removal) is the removal or destruction of something from an object by vaporization, chipping, erosive processes, or by other means."
which is what one does to the model during... well, ablation.
- gliptic 3mo agoExcept we're talking about a _different_ word, a word that was _coined_ as a portmanteau of the word you're referring to and another word.
- larodi 3mo agoRillii ease eat? R U sure https://en.wikipedia.org/wiki/Ablation_(artificial_intelligence) https://en.wikipedia.org/wiki/Ablation_(artificial_intellige... Have you read some (any) actual papers from the word this all and LLMs are? Well here some: https://arxiv.org/abs/1901.08644 https://arxiv.org/abs/1901.08644 Tis ablation ablation and ablation everywhere save for some kid’s fav. model names and their X pals.
- eggsyntax 3mo agoPapers using the term in their title or abstract: https://arxiv.org/search/cs?query=abliteration&searchtype=all&abstracts=show&order=-announced_date_first&size=50 https://arxiv.org/search/cs?query=abliteration&searchtype=al... Note that they're all talking about the same technique, namely applying ablation specifically to the refusal vector as described in https://arxiv.org/abs/2406.11717 https://arxiv.org/abs/2406.11717. I really recommend letting this one go.
- gliptic 3mo agoThe very wikipedia page you're linking says: > The term abliteration has been coined for the process of using ablation to uncensor large language models by modifying internal functions to completely eliminate refusal behaviors while preserving the remaining functions of the model. The word is a portmanteau that combines the words ablation and obliteration. So are you dropping this now?