3 ms·
How exactly does distilling a censored model produce an uncensored model?
by nitros 9mo ago
How exactly does distilling a censored model produce an uncensored model?
- nebezb 9mo agoIt doesn't. Anthropic are, as usual, sounding an alarm to pull the ladder up from behind them.
- ncb9094 9mo agoit technically can. there are patterns that emerge which manifest with no "safegurads" during training
- janalsncm 9mo agoFirst of all this is not technically distillation, it is more imitation learning. Second, you could do something like asking Claude to create 1 million prompt, offensive response, non offensive response triplets. Then train a model with DPO to prefer the offensive responses.