3 ms·
Apart from the usual hypocrisy, > Safety controls may be lost – models trained on Claude's Outputs won't have our safety measures, potentially leading to harmf
by lifthrasiir 2mo ago
Apart from the usual hypocrisy,
> Safety controls may be lost – models trained on Claude's Outputs won't have our safety measures, potentially leading to harmful or dangerous AI systems. We also have no visibility into deployment, meaning we cannot monitor how these distilled models are used or prevent misuse.
So was that why your models caused three real-world security incidents?
- mysterydip 2mo ago> So was that why your models caused three real-world security incidents? No, that was just marketing :)
- Chris2048 2mo agoIsn't that someone else's problem anyway? Someone else's model trained on your outputs is still someone else's model. > we cannot monitor how these distilled models are used or prevent misuse which is fine since they are none of your (their) business.. I think the only possible concern is using their models name - making it clear it's a new model merely trained in another one should fix that.