3 ms·
We tried using OpenAI/Davinci for SQL query authoring, but it quickly became obvious that we are still really far from something the business could find value i
by bob1029 5y ago
We tried using OpenAI/Davinci for SQL query authoring, but it quickly became obvious that we are still really far from something the business could find value in. The state of the art as described below is nowhere near where we would need it to be:
https://yale-lily.github.io/spider https://yale-lily.github.io/spider
https://arxiv.org/abs/2109.05093 https://arxiv.org/abs/2109.05093
https://github.com/ElementAI/picard https://github.com/ElementAI/picard
To be clear, we haven't tried this on actual source code (i.e. procedural concerns), so I feel like this is a slightly different battle.
The biggest challenge I see is that the queries we would need the most assistance with are the same ones that are the rarest to come by in terms of training data. They are also incredibly specific in the edge cases, many time requiring subjective evaluation criteria to produce an acceptable outcome (i.e. recursive query vs 5k lines of unrolled garbage).
- seibelj 5y ago> … but it quickly became obvious that we are still really far from something the business could find value in. My experience with basically everything that is marketed as AI.