This is the use-case that OpenAI on Azure is trying to solve. It supports finetuning, too. Not cheap, though. I think most companies will end up hosting an LLM

This is the use-case that OpenAI on Azure is trying to solve. It supports finetuning, too. Not cheap, though. I think most companies will end up hosting an LLM on local code rather than using OpenAI on Azure, but for now, there is no equivalently-capable replacement.