You can currently do this in an M2 Max with ollama and a Nextjs UI [0] running in a docker container. Any devices in the network can use the UI... and I guess i

You can currently do this in an M2 Max with ollama and a Nextjs UI [0] running in a docker container. Any devices in the network can use the UI... and I guess if you want a LAN API you just need to run another container with with OAI compatible API that can query ollama.. eg [1] [0]https://github.com/ivanfioravanti/chatbot-ollama https://github.com/ivanfioravanti/chatbot-ollama [1]https://github.com/BerriAI/litellm https://github.com/BerriAI/litellm