3 ms·

still looking for vLLM to support Mac ARM Metal GPUs

• baggiponte 1y ago
  Yeah. The docs tell you that you should build it yourself, but…
  • tough 1y ago
    but unlike cuda there's no custom kernels for inference in vllm repo... I think