4 ms·
Agreed. Everything an LLM emits is 'faking' because, of course, it has no real values at all.
by JoeAltmaier 2y ago
Agreed. Everything an LLM emits is 'faking' because, of course, it has no real values at all.
- Terr_ 2y agoOr the entire framing--even the word "faking"--is problematic, since the dreams being generated are both real and fake depending on context, and the goals of the dreamer (if it can even be said to have any) are not the dreamed-up goals of dreamed-up characters.
- no-dr-onboard 2y agoWhen did we get to call agents dreamers? That too seems like jargon that has a bunch of context to it that could easily be misplaced.
- Terr_ 2y agoThere somewhere where "dreaming" is really jargon, a technical term of art? I thought it would be taken as an obvious poetic analogy, (versus "think" or "know") while also capturing the vague uncertainty of what's going on, the unpredictability of the outputs, and the (probable) lack of agency. Perhaps "stochastic thematic generator"? Or "fever-dreaming", although that implies a kind of distress.
- GolDDranks 2y agoHow do you define having real values? I'd imagine that a token-predicting base model might not have real values, but RLHF'd models might have them, depending on how you define the word?
- JoeAltmaier 2y agoIf it doesn't feel panic in its viscera when faced with a life-threatening or value-threatening situation, then it has no 'real' values. Just academic ones.