4 ms·
This is just a wrapper wrapped with marketing. If you are looking for a proper infrence servers check: easiest : ollama best for servering : vLLM OpenAI Comp
by v3ss0n 3y ago
This is just a wrapper wrapped with marketing. If you are looking for a proper infrence servers check:
easiest : ollama
best for servering : vLLM
OpenAI Compatible : LocalAI
- moralestapia 3y ago>best for servering : vLLM Thanks, I was looking exactly for this!