One of the first things we did when GPT-4 became available was talk to our Azure rep and get access to the OpenAI models that they'd partnered with Microsoft to

One of the first things we did when GPT-4 became available was talk to our Azure rep and get access to the OpenAI models that they'd partnered with Microsoft to host in Azure. Now, we have our own private, not-datamined (so they claim, contractually) API endpoint and we use an OpenAI integration in VS Code[1] to connect to, allowing anyone in the company to use it to help them code. I also spun up an internal chat UI[2] to replace ChatGPT so people can feel comfortable discussing proprietary data with the LLM endpoint. The only thing that would make it more secure would be running inference engines internally, but I wouldn't have access to as good of models, and I'd need a _lot_ of hardware to match the speeds. [1] - https://marketplace.visualstudio.com/items?itemName=AndrewButson.vscode-openai https://marketplace.visualstudio.com/items?itemName=AndrewBu... [2] - https://github.com/mckaywrigley/chatbot-ui https://github.com/mckaywrigley/chatbot-ui (legacy branch)