3 ms·
TBH, I REALLY like the tiny models. Like smollm2. Also lobotomized LLMs ("abliterated") can be a lot of fun.
by DeepSeaTortoise 2y ago
TBH, I REALLY like the tiny models. Like smollm2.
Also lobotomized LLMs ("abliterated") can be a lot of fun.
- kjrfghslkdjfl 2y ago[dead]
- andai 2y agoI think you mean un-lobotomize, and apparently it can be done without retraining? Wild! https://huggingface.co/blog/mlabonne/abliteration https://huggingface.co/blog/mlabonne/abliteration
- memhole 2y agoThanks for clarifying that. I can understand their take. But, I also think of the models without abliteration as lobotomized