4 ms·
OpenArc – Lightweight Inference Server for OpenVINO
- yjftsjthsd-h 2y agoSo is this meant to be used by end users to run models and provide an API like ollama? I don't entirely follow the readme, though I think that's a context problem.
- Tostino 2y agoPretty much, other than they just came up with their own incompatible API rather than implementing the OpenAI endpoints.