3 ms·
> Right, like the other commenter suggested, that's an infrastructure-level thing, not a model-level thing. By default, the ChatGPT "model" knows to not try to
by MuffinFlavored 3y ago
> Right, like the other commenter suggested, that's an infrastructure-level thing, not a model-level thing.
By default, the ChatGPT "model" knows to not try to do math and instead write code to do the math then run it. I get that it's set up infrastructure wise to be able to run it, but why is Claude's main chat UI not trying to instead respond
"hey, do this calculation on your own since I can't" or something of this nature instead of responding to math incorrectly
- cosmojg 3y agoBecause ChatGPT ships with a system prompt which instructs the underlying model to do exactly that. A similar web application could be developed for Claude, and it would perform similarly with the right prompt, as it's quite good at tool use. For example, I'm able to get Claude-3-Opus to write Python and call a Python interpreter of its own accord when questioned about time series data in some of my data analysis workflows, though I haven't glued together a pretty GUI for it yet (e.g., plots are simply saved to disk). While I haven't run into any problems around calculations yet, I'm sure it wouldn't be too hard to further refine the system prompt and ensure that all calculations are performed or checked using Python.