3 ms·
> think the lesson is: smaller models hallucinate more The interesting part isn't the hallucination, but the sheer unwillingness to take in new information.
by 9rx 1y ago
> think the lesson is: smaller models hallucinate more
The interesting part isn't the hallucination, but the sheer unwillingness to take in new information.
- dragonwriter 1y agoMight have dug in less on the confabulation about information outside of its knowledge cutoff if the new information weren't offered with support from a user “hallucination” about information within its knowledge cutoff. More detail: https://news.ycombinator.com/item?id=44809145 https://news.ycombinator.com/item?id=44809145
- 9rx 1y ago> Might have dug in less... The digging in at all is what is interesting. Like an earlier comment alluded to, the presumptive value of these tools is being able to feed it your own information where that information is to be considered authoritative. > More detail: [...] "He, in fact, did run for reelection" A slow walk, maybe. He was in no condition to run. That is why he ultimately dropped out. But, really, that statement is just a silly game of semantics. "Run", when used in hindsight, often implies completion. This LLM model even says so too. If a model doesn't understand nuance, that is also interesting.