4 ms·
If OpenAI says they walked away with the weights this is a possibility but it doesn't look like they have so it can't be a distill.
by BoredPositron 2y ago
If OpenAI says they walked away with the weights this is a possibility but it doesn't look like they have so it can't be a distill.
- isaacfrond 2y agoTo distill a neural net the only thing you need is access to the softmax probabilities. You don’t need the weights. This is entirely consistent with the story—-large anounts of data being exfiltrated, not weights but the raw output before sampling.