4 ms·
What command is it? Because that was not at all my experience.
by Zambyte 2y ago
What command is it? Because that was not at all my experience.
- Der_Einzige 2y agoVllm serve… huggingface gives run instructions for every model with vllm on their website.
- Zambyte 2y agoHow do I serve multiple models? I can pick from dozens of models that I have downloaded through Open WebUI.