2 ms·
There is an open PR for VLLM to do this via DefussionGemma https://github.com/vllm-project/vllm/pull/57250 https://github.com/vllm-project/vllm/pull/57250
by mohsen1 14d ago
There is an open PR for VLLM to do this via DefussionGemma
https://github.com/vllm-project/vllm/pull/57250 https://github.com/vllm-project/vllm/pull/57250