4 ms·
Before buying H100s we tested MI300s and they were borderline unusable. If you're just running some popular pretrained models out of the box, sure. But you're
by light_hue_1 2y ago
Before buying H100s we tested MI300s and they were borderline unusable.
If you're just running some popular pretrained models out of the box, sure.
But you're saying that you develop new model architectures on them? And it works reliably? That's not at all what we saw.
- latchkey 2y agoA lot has changed in only a few months. ROCm has gone through several revisions in a short amount of time. I'm curious where you did your testing. By the way, this was just done... https://www.reddit.com/r/AMD_MI300/comments/1dgimxt/benchmarking_brilliance_single_amd_mi300x_vllm/ https://www.reddit.com/r/AMD_MI300/comments/1dgimxt/benchmar...