2 ms·
Yes but the abliterated versions (those with partially removed guardrails) are significantly “dumber” so the trade off isn’t worthwhile imho.
by mattpavelle 1y ago
Yes but the abliterated versions (those with partially removed guardrails) are significantly “dumber” so the trade off isn’t worthwhile imho.
- hnuser123456 1y agoResearch also often finds that fine-tuning in more guardrails also decreases performance, which is done to all non-base instruction tuned models, which most people are using.