4 ms·

What do you mean by complex SQL? How complex?

• aazo11 3y ago
  For large databases, LLMs do not perform well if you pass the entire schema (either run into context window issues or confuse the LLM with too much info). There is a schema linking step that identifies the relevant schema and only passes that. The schema linking is also done in the fine-tuning process.
  • deely3 3y ago
    Good, but.. What do you mean by complex SQL? How complex?
    • aazo11 3y ago
      The largest we have successfully deployed is on the OSQuery schema https://osquery.io/ https://osquery.io/ which is 277 tables and lots of business context (malwares, vulnerabilities, Windows registry keys, etc).
• edmundsauto 3y ago
  I've been playing w/ this product self-hosted for a few weeks. It can join across multiple tables, windowing functions. I haven't tried self-joins yet, nor I have put much effort into tuning w/ Golden SQL or other documentation. I would put this at the skill level of a junior data engineer. It's pretty impressive.
  • aazo11 3y ago
    Glad you have been liking it. Feel free to reach out at amir (at) dataherald.com if you need any additional help setting up.