3 ms·
In the very next sentence after the one you quote, I say “Even if you decode the weights from floats to strings, you won't find the strings of code stored anywh
by fwlr 3y ago
In the very next sentence after the one you quote, I say “Even if you decode the weights from floats to strings, you won't find the strings of code stored anywhere.”
If you decode the jpeg file you do get the pixel values.
- friendzis 3y agoThe whole debate is that when you decode the weights (i.e. "run AI on some prompt") you do in fact get training code reproduced verbatim. The fact that we do not have tools to analyze this decoding function analytically is orthogonal.
- greysphere 3y agoYou don't get the exact pixel values decoding a jpeg. But for a lot of uses, what you get is close enough. One could describe llms similarly.