3 ms·
What's the best way to run this is I prefer to use local GPUs?
by beebaween 2y ago
What's the best way to run this is I prefer to use local GPUs?
- EarlyOom 2y agoYou can try out some of our schemas with Ollama if you want: https://github.com/vlm-run/vlmrun-hub https://github.com/vlm-run/vlmrun-hub (instructions in Readme)
- fzysingularity 2y agoWe’re adding this as we speak. Ollama support is already there, and here’s vLLM inference: https://github.com/vlm-run/vlmrun-hub/pull/120 https://github.com/vlm-run/vlmrun-hub/pull/120