3 ms·
The point is that model alignment ensures the model's security and safety, especially in public-facing applications. If alignment is removed through fine-tuning
by usrhack 2y ago
The point is that model alignment ensures the model's security and safety, especially in public-facing applications. If alignment is removed through fine-tuning, the model becomes unsafe for use in such contexts.
- Hizonner 2y agoIf ensuring that kind of "safety" (a massive misuse of the word) were an actual security concern, then neither the original, "aligned", un-fine-tuned model, nor a model with an outboard "jailbreak detector", would ever be reliable enough for the word "ensure" to apply, and no sane person would deploy them at all. The "alignment" technologies do not work and nobody knows how to make them work.