I think the quote came out to $107k. 4 AMD MI300A's. Around 60k tokens per second, 512GB of GPU memory. https://www.gigabyte.com/Enterprise/GPU-Server/G383-R80

I think the quote came out to $107k. 4 AMD MI300A's. Around 60k tokens per second, 512GB of GPU memory. https://www.gigabyte.com/Enterprise/GPU-Server/G383-R80-AAP1 https://www.gigabyte.com/Enterprise/GPU-Server/G383-R80-AAP1