2 ms·
LocalAI seems like a interesting project that allows self-hosted can be easily called over the network. Open AI compatible interface https://github.com/go-skyn
by FloatArtifact 3y ago
LocalAI seems like a interesting project that allows self-hosted can be easily called over the network. Open AI compatible interface https://github.com/go-skynet/LocalAI https://github.com/go-skynet/LocalAI
- sestinj 3y agoThanks for sharing! We've been recommending something similar with these llama-cpp-python bindings https://github.com/abetlen/llama-cpp-python#web-server https://github.com/abetlen/llama-cpp-python#web-server, but I'll have to check that out