3 ms·
That some models get it right is irrelevant. In general, if your instructions require computation, it's safer to assume it won't get it right and will hallucina
by BeetleB 2y ago
That some models get it right is irrelevant. In general, if your instructions require computation, it's safer to assume it won't get it right and will hallucinate.
- scarface_74 2y agoThe reasoning models all do pretty good at math. Have you tried them? This is something I threw together with o3-mini https://chatgpt.com/share/679d5305-5f04-8010-b5c4-61c31e79b248 https://chatgpt.com/share/679d5305-5f04-8010-b5c4-61c31e79b2... ChatGPT 4o doesn’t even try to do the math internally and uses its built in Python interpreter. (The [_>] link is to the Python code) https://chatgpt.com/share/679d54fe-0104-8010-8f1e-9796a08cf930 https://chatgpt.com/share/679d54fe-0104-8010-8f1e-9796a08cf9... DeepSeek handles the same problem just as well using the reasoning technique. Of course ChatGPT 4o went completely off the rails without using its Python interpreter https://chatgpt.com/share/679d5692-96a0-8010-8624-b1eb091270cb https://chatgpt.com/share/679d5692-96a0-8010-8624-b1eb091270... (The break down that it got right was using Python even though I told it not to)