3 ms·
more like an artefact of the inability to lie than a hallucination
by nathias 1y ago
more like an artefact of the inability to lie than a hallucination
- dotancohen 1y agoNo analogy needed. It's actually because "Yes it exists" is a linguistically valid sentence and each word is statistically likely to follow the former word. LLMs produce linguistically valid texts, not factually correct texts. They are probability functions, not librarians.
- nathias 1y agothis was no analogy, it really can't lie...
- astrange 1y agoThose are not two different things. A transistor is a probability function but we do pretty well pretending it's discrete.
- dotancohen 1y agoTransitors at the quantum level are probability functions just like everything else is. And just like everything else, at the macro level the overall behavior follows a predictable known pattern. LLMs have nondeterministic properties intrinsic to their macro behaviour. If you've ever tweaked the "temperature" of an LLM, that's what you are tweaking.
- astrange 1y agoTemperature is a property of the sampler, which isn't strictly speaking part of the LLM, though they co-evolve. LLMs are afaik usually evaluated nondeterministically because they're floating point and nobody wants to bother perfectly synchronizing the order of operations, but you can do that. Or you can do the opposite: https://github.com/EGjoni/DRUGS https://github.com/EGjoni/DRUGS