3 ms·
Can this be run on-prem (like rstudio server) against OpenAI API compatible LLMs (i.e internal deployments)?
by alfalfasprout 1y ago
Can this be run on-prem (like rstudio server) against OpenAI API compatible LLMs (i.e internal deployments)?
- WillNickols 1y agoIt can, but it'll take more set up since there's a backend we have configured that does the actual LLM communication. You'd need to set that up internally for an on-prem deployment. Can you send us a message (https://www.lotas.ai/contact https://www.lotas.ai/contact) if you want to talk more?