3 ms·
It always strikes me as odd how much of using LLMs is doing the dumb plumbing of transferring/connecting data in and out of the LLM and whatever domain things a
by jmull 2y ago
It always strikes me as odd how much of using LLMs is doing the dumb plumbing of transferring/connecting data in and out of the LLM and whatever domain things are involved. The LLM is doing the interesting stuff, and we get to do data entry.
So now there are tools like this to help automate this simple work, but I wonder why the LLM can’t already handle it… “create a tool to automate querying a SQLite database using an LLM”
- lxgr 2y ago> The LLM is doing the interesting stuff, and we get to do data entry. I'd say it's just the opposite: I'm telling the LLM what outcome I want (and, currently, how I want it to go about doing that, since it often can't figure it out itself), and it handles the low level details of getting the SQL syntax right, tapering over minor details in available utility functions and syntactic sugar across databases.