2 ms·
I wonder if this will survive distillation. I vaguely recall that most open models answer “ I am chat gpt” when asked who they are, as they’re heavily trained o
by QuadmasterXLII 1y ago
I wonder if this will survive distillation. I vaguely recall that most open models answer “ I am chat gpt” when asked who they are, as they’re heavily trained on openai outputs. If the version of chatgpt used to generate the training data had a watermark, a sufficiently powerful function approximator would just learn the watermark.
- xpe 1y agoAre you expecting a distilled model to be sufficiently powerful to capture the watermark? I wouldn’t. Additionally, I don’t think the watermark has to be deterministic.