4 ms·did you run inference with vllm?by segmondy 1mo agodid you run inference with vllm?srcreigh 1mo agoNo, I don't own any of this hardware, im just summarizing what I could find by reading others posted benchmarks