3 ms·
> newer LLMs appear to be great at arithmetic, but they still fail basic counting tests How does the performance of today's LLMs contradict Ilya's statement?
by WithinReason 2y ago
> newer LLMs appear to be great at arithmetic, but they still fail basic counting tests
How does the performance of today's LLMs contradict Ilya's statement?
- aithrowaway1987 2y agoBecause they can learn a bunch of symbolic formal arithmetic without learning anything about quantity. They can learn 5 x 3 = 15 without learning ***** **** ******* ***** = ***** = ******* ***** ****** * And this generalizes to almost every sentence an LLM can regurgitate.
- WithinReason 2y agoThe latter can be learned from "statistical correlations in text", just like Ilya said.