Did you mean user interface or API? Anyway for UI you could look at chainlit, for API some of the models are already getting wrapped up in an open ai compatibl

Did you mean user interface or API? Anyway for UI you could look at chainlit, for API some of the models are already getting wrapped up in an open ai compatible rest interface. See https://github.com/go-skynet/LocalAI https://github.com/go-skynet/LocalAI