4 ms·
Pretty sure your computer can calculate 10+10 without an LLM.
by badgersnake 3y ago
Pretty sure your computer can calculate 10+10 without an LLM.
- minimaxir 3y agoIt's a test case.
- viraptor 3y agoIt's a bad test case. You should know why you're choosing a given test. I hope people will understand why "solve this equation" doesn't work with LLMs and why "transform this into python code" does much better.
- minimaxir 3y agoWhy not both? They're distinct enough, and there's no such thing as too many distinct test cases.
- deleted 3y ago[deleted]
- Solvency 3y agoWhy can't it transform 10 + 10 into 20 (equivalency) if it can do so with code?
- minimaxir 3y agoAddition is a different problem for LLMs than code solving, since the latter is easier to memorize.