3 ms·
We’re adding this as we speak. Ollama support is already there, and here’s vLLM inference: https://github.com/vlm-run/vlmrun-hub/pull/120 https://github.com/vlm
by fzysingularity 2y ago
We’re adding this as we speak. Ollama support is already there, and here’s vLLM inference: https://github.com/vlm-run/vlmrun-hub/pull/120 https://github.com/vlm-run/vlmrun-hub/pull/120