4 ms·
There's also LocalAI[0] which allows the use of local LLMs with an OpenAI compatible API. [0] https://github.com/go-skynet/LocalAI https://github.com/go-skynet
by michaelmior 3y ago
There's also LocalAI[0] which allows the use of local LLMs with an OpenAI compatible API.
[0] https://github.com/go-skynet/LocalAI https://github.com/go-skynet/LocalAI
- jackmpcollins 3y agoThanks for sharing! LocalAI supports function calling[0] so this should work for most or all features of magentic - I'm interested to see if concurrent requests work. I will test this out. [0] https://localai.io/features/openai-functions/ https://localai.io/features/openai-functions/