4 ms·

Fun fact: Nvidia H200 are currently half the price/hr of H100 bc people can’t get vLLM to work on it. https://x.com/nisten/status/1871325538335486049 https://x

Fun fact: Nvidia H200 are currently half the price/hr of H100 bc people can’t get vLLM to work on it. https://x.com/nisten/status/1871325538335486049 https://x.com/nisten/status/1871325538335486049

adrian_b 2y ago
That seems like a CPU problem, not a GPU problem (due to Aarch64 replacing x86-64).
ryao 2y ago
That is GH200 and it is likely due to an amd64 dependency in vLLM.