> Nobody knows how the LLM does it From a completely technical perspective, we have a rough idea how the LLMs work, and improving a system requires measuring o

> Nobody knows how the LLM does it From a completely technical perspective, we have a rough idea how the LLMs work, and improving a system requires measuring outcomes and you don't necessarily need to understand the mechanism. EXPLAIN ANALYZE against data that's similar in size to prod checks a query written by an LLM as good as anything we can write... but, yes, you're right, we still didn't solve the halting problem - neither the LLMs.