4 ms·
How does this compare to LocalAI? https://github.com/mudler/LocalAI https://github.com/mudler/LocalAI
by westurner 3y ago
How does this compare to LocalAI? https://github.com/mudler/LocalAI https://github.com/mudler/LocalAI
- Tiberium 3y agoThe AI Proxy from the post is for using multiple local and remote LLMs over the OpenAI API (along with API key management apparently), while LocalAI is only for using local LLMs.
- westurner 3y agopromptfoo and ChainForge do multi-LLM comparisons and benchmarking: https://news.ycombinator.com/item?id=37447885 https://news.ycombinator.com/item?id=37447885
- davidatbt 3y agoThis looks awesome - thanks for sharing! Yeah I think it's just local vs. hosted models.