3 ms·
It's someone taking llama.cpp, strapping it to a HTTP server lib and implementing the OpenAI REST API, then putting some effort into a shiny website and docs, b
by sho_hn 3y ago
It's someone taking llama.cpp, strapping it to a HTTP server lib and implementing the OpenAI REST API, then putting some effort into a shiny website and docs, because AI-anything is a reputation and/or investment magnet right now.
Not that it isn't a nice idea -- making it easy to test existing OpenAI-based apps against competing open models is a pretty good thing.
- toddmorey 3y agoOr… it’s just someone who wanted to build cool stuff. I see the value in being able to locally run apps designed to talk to OpenAI apis.
- brucethemoose2 3y agoThere are dozens of other endpoints that will do this, and possibly do it better. I'm all for cool innovations, but... I'm not really seeing the advantage here beyond the shiny website to attract VCs.