3 ms·
Can someone tell me the mechanism by which the prompts are even recovered? Cosma Shalizi says that this isn't possible. Are they in the training set? I doubt i
by brcmthrowaway 11mo ago
Can someone tell me the mechanism by which the prompts are even recovered?
Cosma Shalizi says that this isn't possible. Are they in the training set? I doubt it.
http://bactra.org/notebooks/nn-attention-and-transformers.html#prompt-uncovering http://bactra.org/notebooks/nn-attention-and-transformers.ht...
- simonw 11mo agoThere's a detailed description of how they were recovered here: https://www.lesswrong.com/posts/vpNG99GhbBoLov9og/claude-4-5-opus-soul-document https://www.lesswrong.com/posts/vpNG99GhbBoLov9og/claude-4-5... Plus these transcripts showing the chats: https://gist.github.com/Richard-Weiss/efe157692991535403bd7e7fb20b6695#file-relevant_chats-md https://gist.github.com/Richard-Weiss/efe157692991535403bd7e...
- brcmthrowaway 11mo agoI mean a mathematical description of how they were recovered