3 ms·
sweet, is there any plans to implement VLLM in the future?
by nshotton 3mo ago
sweet, is there any plans to implement VLLM in the future?
- segmenta 3mo agovLLM works today - it exposes an OpenAI-compatible endpoint, and you can point Rowboat at a custom base URL in model settings.