4 ms·did you run inference with vllm?by segmondy 3mo agodid you run inference with vllm?srcreigh 3mo agoNo, I don't own any of this hardware, im just summarizing what I could find by reading others posted benchmarks