4 ms·

Please add support for open-source LLMs from Hugging Face :)

• rubenfiszel 3y ago
  Yes, we will do this next and address this in the post. We wanted to validate the approach first using the best model available but using another model is just one endpoint change away in the codebase https://github.com/windmill-labs/windmill/blob/8d550a7ea5708ccae1136f4c0445fd9e4573341c/backend/windmill-api/src/openai.rs#L108 https://github.com/windmill-labs/windmill/blob/8d550a7ea5708... As an open-source project ourselves, it is pretty obvious next step!