4 ms·

Any solutions like this that work with self hosted models?

• aazo11 3y ago
  Depends what you mean by 'work.' You can definitely use them, but GPT-4 is the only model that generates good SQL without lots of training + fine-tuning (and it is very difficult/impossible to come up with Nl <> SQL training sets). So GPT-4 is the only model that works well in terms of accuracy for now. That being said, I am pretty sure the self hosted models will get there very soon. Are you looking to deploy a solution with a self-hosted model?
  • hansonw 3y ago
    What about datasets like https://huggingface.co/datasets/b-mc2/sql-create-context https://huggingface.co/datasets/b-mc2/sql-create-context? An OSS model based on StarCoder was also recently published which is roughly between GPT-3.5 and GPT-4: https://github.com/defog-ai/sqlcoder https://github.com/defog-ai/sqlcoder
  • cloudking 3y ago
    Yes, we have use cases that can't leverage GPT-4 for data privacy reasons. I was curious if any self hosted models would suffice and could be integrated.
    • saigal 3y ago
      GPT4 is best right now for all the reasons you likely already know. We are working on self-hosted but for right now it is GPT4. We can let you know when we work on self-hosted, which will no doubt come in the future. feel free to email me at anuj at dataherald dot com or sign up on our site (https://www.dataherald.com/contact https://www.dataherald.com/contact) and i will keep you posted. i should note that our (dataherald's) product only sends schema to the LLM, which is important to note.