3 ms·
A box of AMD MI300x (1.5TB of memory) is much less than $500k and AMD made sure to have day zero support with vLLM. That said, I'm obviously biased but you're
by latchkey 2y ago
A box of AMD MI300x (1.5TB of memory) is much less than $500k and AMD made sure to have day zero support with vLLM.
That said, I'm obviously biased but you're probably better off renting it.