4 ms·
The MI300 is a massive GPU compared to even the new H200. It was designed as a combined CPU/GPU for supercomputers, with shared memory. But then the AI craze h
by brucethemoose2 3y ago
The MI300 is a massive GPU compared to even the new H200.
It was designed as a combined CPU/GPU for supercomputers, with shared memory. But then the AI craze hit, so AMD spun a variant into a pure GPU AI accelerator real quick, which they could actually pull off because the GPU silicon is modular.
...So thats why it cost a fortune. Its really a jury rigged HPC product.
- pclmulqdq 3y agoThe H100 is, to some degree, also a jury rigged HPC product. The H200 is starting to reach a more "AI" balance between compute and memory bandwidth.
- treprinum 3y agoI can see MI300 being used for CFD, nuclear physics simulation, cloud GPU virtualization etc. but for AI it's simply not there regardless of AMD's and its affiliated startups' marketing.