4 ms·
I don’t understand why LLM’s aren’t already set up to do what you describe automatically behind the curtain. Extract a math equation from text (LLMs are good at
by ip26 2y ago
I don’t understand why LLM’s aren’t already set up to do what you describe automatically behind the curtain. Extract a math equation from text (LLMs are good at translating between languages right?) and immediately evaluate it on the host CPU.
LLM is the equivalent of recalling your times tables. Computer arithmetic is the equivalent of re-computing your times tables.
- dragonwriter 2y ago> I don’t understand why LLM’s aren’t already set up to do what you describe automatically behind the curtain. LLM-based systems with tool use (which this is an application of) often are, to an extent, the issue is tuning the (behind the scenes, system) prompting so that they use appropriate tools in every case where they should, and do so correctly. (There's also a cost factor involved since behind-the-scenes tool use means multiple LLM round trips to answer the question, so tuning the system to use tools more aggressively makes the system more expensive.)
- pbhjpbhj 2y agoChatGPT does do this sort of process for arithmetic now; it converts wordbased problems to mathematical notation and then solves.