4 ms·
Exactly. What I consider a patch and definitely a symptomatic solution is "solved" via agents that search the web (e.g. asking for the weather forecast of this
by frag 2y ago
Exactly. What I consider a patch and definitely a symptomatic solution is "solved" via agents that search the web (e.g. asking for the weather forecast of this year - in that case the LLM cannot know the year I am referring to, if not via a web search).
Generally speaking, LLMs lack direct temporal awareness. Standard models do not model the flow of time unless explicitly. Some models can encode a model of time when trained on sequential video data and rely on external encoders to provide temporal structure. But that is a very narrow application (video in this example). That cannot be considered a generic form of awarenes of time as a concept through which facts can change.