3 ms·
Those models still can't reliably do arithmetic, so how could it possibly know that number unless it's a commonly repeated fact? Also: would you expect random
by KeplerBoy 2y ago
Those models still can't reliably do arithmetic, so how could it possibly know that number unless it's a commonly repeated fact?
Also: would you expect random people to fare any better?
- chrischen 2y agoArithmetic just happens to be something we can easily and reliably verify, so it becomes painfully obvious when LLMs are just stringing together some words that sound like the right answer.
- bckr 2y agoIt used web search (RAG over the entire web) and analysis (math tool) and still came up with the wrong answer. It has done more complex things for me than this and, sometimes, gotten it right. Yes, it’s supposed to be able to do this.