4 ms·
Do you have a citation for the existence of an LLM "world model"? My understanding of retrieval-augmented generation is that it is an attempt to add a world mo
by mcguire 2y ago
Do you have a citation for the existence of an LLM "world model"?
My understanding of retrieval-augmented generation is that it is an attempt to add a world model (based on a domain-specific knowledge database) to the LLM; the result of the article is that the combination still hallucinates frequently.
I might even go further to suggest that the latter part of your comment is entirely anthropomorphization.
- edmara 2y agohttps://arxiv.org/abs/2310.02207 https://arxiv.org/abs/2310.02207 https://transformer-circuits.pub/2024/scaling-monosemanticity/index.html https://transformer-circuits.pub/2024/scaling-monosemanticit...