2 ms·
The quirky thing to remember about gpt-3 is that it really is just a giant autocomplete based on the internet. It can do math insofar as it’s memorized some tex
by lumost 5y ago
The quirky thing to remember about gpt-3 is that it really is just a giant autocomplete based on the internet. It can do math insofar as it’s memorized some text which did that math with slightly different verbiage etc.
If you ask it to compute something that would never have been seen on the internet it’s likely to fail. E.g. add 2 extremely large/rare numbers together
- fossuser 5y agoYou should read the excerpts in the paper I link to which suggest otherwise (that it’s not memorized and that it’s deducing rules).
- vladTheInhaler 5y agoAs another poster indicates, that's specifically not the case. Most possible arithmetic problems of reasonable size aren't anywhere in the dataset, but it can solve them with pretty good accuracy.