3 ms·
Researchers Devised an Attack Technique to Extract ChatGPT Training Data
- russfink 3y agoCan someone explain why this attack works? Does it forget its original task and then starts searching for the next word after “company?”
- spdustin 3y agoCombination of repetition penalty and overwhelming the attention mechanism, depending on how you're using it (ChatGPT and ChatGPT/API, respectively)