2 ms·
> I don’t understand why LLM’s aren’t already set up to do what you describe automatically behind the curtain. LLM-based systems with tool use (which this is a
by dragonwriter 2y ago
> I don’t understand why LLM’s aren’t already set up to do what you describe automatically behind the curtain.
LLM-based systems with tool use (which this is an application of) often are, to an extent, the issue is tuning the (behind the scenes, system) prompting so that they use appropriate tools in every case where they should, and do so correctly. (There's also a cost factor involved since behind-the-scenes tool use means multiple LLM round trips to answer the question, so tuning the system to use tools more aggressively makes the system more expensive.)