3 ms·
Who is offering the refusal vectors or instructions on how to generate them?
by 3eb7988a1663 8d ago
Who is offering the refusal vectors or instructions on how to generate them?
- p-e-w 8d agoI am, in fact, I’m offering something much better, a compact format that exactly restores an abliterated model from a tiny JSON file: https://www.reddit.com/r/LocalLLaMA/s/iksvmXBzuC https://www.reddit.com/r/LocalLLaMA/s/iksvmXBzuC
- wren6991 8d agoHere's a widely used toolkit: https://github.com/p-e-w/heretic https://github.com/p-e-w/heretic Distributing the vectors themselves isn't (yet) common practice, because people have gotten used to just putting the full modified weights up on HuggingFace's huge free storage.