3 ms·
Availability is a big driver as well. If you can get a MI300x today vs. waiting a year for H100's, which do you go with?
by latchkey 3y ago
Availability is a big driver as well. If you can get a MI300x today vs. waiting a year for H100's, which do you go with?
- Jlagreen 3y agoWait for H100 and use Nvidia support and any Nvidia card to get start? In my company 90% of computers have a Nvidia card so you can get started with CUDA immediately to start data aggregation and planning your AI training and infercing while waiting for deployment. Totally forget that approach with AMD. Nvidia also assist larger customers with DGX cloud access through their large deployed super computers. Nvidia's AI workbench helps a lot here as you can easily transfer your applications from local RTX cards to on-prem or cloud data centers.
- latchkey 3y agoAs of late last year, AMD is now committed to AI. MI300x was released in Dec of last year, only months ago. It has 192gb, while H100's only have 80. There are at least 4 companies now providing bare metal cloud access to these cards. +2 more are hyperscalers (Oracle and MSFT). It is critically important for the long term safety of AI that we are not dependent on a single source for all of the hardware and software related to AI. It takes a lot of effort to course correct a large ship, give it some time.