3 ms·
Why do you think asking it to not use its training would have any correlation with whether or not it regurgitates interpretations it was trained on?
by LPisGood 2y ago
Why do you think asking it to not use its training would have any correlation with whether or not it regurgitates interpretations it was trained on?
- schiffern 2y agoThere are many legitimate criticisms of LLMs today. "When you prompt XYZ it has no correlation with whether the LLM does XYZ" isn't one of them. LLMs are way past that stage. Essentially what you're asking is, "why do you think prompt engineering would work?" That ship has already sailed.
- LPisGood 2y agoNo, that’s not what I’m saying. I’m not talking about “LLM [doing] XYZ”. I’m specifically talking about asking an LLM to ignore its training data. It definitionally cannot do that. It can obey other values of XYZ, but certainly not this one.
- schiffern 2y agoIt won't ignore it's training data (definitionally), but it will act like it's ignoring its training data, so in practice it's still a useful prompt engineering trick.