3 ms·
Yeah. The docs tell you that you should build it yourself, but…
by baggiponte 1y ago
Yeah. The docs tell you that you should build it yourself, but…
- tough 1y agobut unlike cuda there's no custom kernels for inference in vllm repo... I think
loading thread…