4 ms·
None of the things you mention are guaranteed to increase the probability of correctness. You can run the LLM output through as many deterministic programs as y
by tempfile 16d ago
None of the things you mention are guaranteed to increase the probability of correctness. You can run the LLM output through as many deterministic programs as you like, but "the query plan runs in acceptable time" is not something you can verify with such a tool. Nobody knows how the LLM does it, so they cannot know how to make the LLM do it better.
- malisper 16d agoEven if the query plan was not generated by an llm, you can't verify it will run in an acceptable time. This is one of the biggest unsolved problems in databases
- Tanjreeve 15d agoSo what is an LLM bringing to the table if it's not just a fun experiment?
- egeozcan 16d ago> Nobody knows how the LLM does it From a completely technical perspective, we have a rough idea how the LLMs work, and improving a system requires measuring outcomes and you don't necessarily need to understand the mechanism. EXPLAIN ANALYZE against data that's similar in size to prod checks a query written by an LLM as good as anything we can write... but, yes, you're right, we still didn't solve the halting problem - neither the LLMs.