3 ms·
We built a correctness checker for LLM-generated SQL code for the military before LLMs were commercially available, it is going live soon on http://sql.ai http:
by gremgoth 2y ago
We built a correctness checker for LLM-generated SQL code for the military before LLMs were commercially available, it is going live soon on http://sql.ai http://sql.ai . Some people do care about this problem, but it is hard to solve; even for SQL alone, this requires significant computer algebra, automated theorem proving, having to define what 'correct' even means, and much else etc.
- shafyy 2y agoIt's impossible to solve with LLMs. You keep adding RAGs until you're back at a non-LLM implementation. LLMs are probabilistic. Most programs, including SQL, need to be deterministic to provide value.