3 ms·
I am using the `voipmonitor/vllm:lucifer` docker from the RTX6K discord community discussed at the same link the other commenter posted. It is based around this
by mtone 4mo ago
I am using the `voipmonitor/vllm:lucifer` docker from the RTX6K discord community discussed at the same link the other commenter posted. It is based around this PR https://github.com/vllm-project/vllm/pull/43477 https://github.com/vllm-project/vllm/pull/43477
- arjie 4mo agoAh I’m on the same PR just behind. Thank you.