3 ms·
https://i.imgur.com/l2elIAv.png https://i.imgur.com/l2elIAv.png Difficulty is the amount of digits, small models struggle with 10 digits numbers, gemini and gp
by Kuinox 1y ago
https://i.imgur.com/l2elIAv.png https://i.imgur.com/l2elIAv.png
Difficulty is the amount of digits, small models struggle with 10 digits numbers, gemini and gpt-5 are very good recent models, gemini start failing before 40 digits, GPT-5 (the one by api, the online chat version is worse and I didn't tested it) can do more than 120 digits (at this point it's pointless to test for more).
- gjm11 1y agoMy tests of GPT-5 were using the online chat version. Of course, I only ran it once; I can't at all rule out the possibility that sometimes it gets it wrong. But, again, the same is true of humans.
- Kuinox 1y agoThe online version is way worse, it also have a router that could route it to a random model.