3 ms·
I'm curious how these 'distillation attacks' work and what the prompts look like to do them.
by pogue 8mo ago
I'm curious how these 'distillation attacks' work and what the prompts look like to do them.
- sigwinch 8mo agoI’m not sure there’s even an adaptive pattern in prompts. The article sounds like a n>1E5 shotgun.
- MagicMoonlight 8mo agoI’m pretty sure they just mean DeepSeek was paying to generate text, and then using this text as training data. Which of course is completely wrong and totally hacking and illegal. Very different from using book torrents or people’s google docs to train your AI.