2 ms·

"while adding AMD (AMD.O), opens new tab chips alongside Nvidia (NVDA.O), opens new tab chips to meet its surging infrastructure demands" Jensen has been sayin

"while adding AMD (AMD.O), opens new tab chips alongside Nvidia (NVDA.O), opens new tab chips to meet its surging infrastructure demands" Jensen has been saying that demand is "insane" and we're hearing rumors of low yields. This equates to supply issues in the coming months/years. No fortune 500 puts all their eggs into one basket. Diversifying away from a single source for all of AI hardware and software, is a smart thing to do.

vineyardmike 2y ago
> Diversifying away from a single source for all of AI hardware and software, is a smart thing to do. I wonder how this squares with the exclusivity contract with Microsoft. Even the OpenAI/Oracle deal requires Oracle to run Azure stack on their datacenter so MSFT can mediate the relationship. The AMD chips mentioned are also purchased by MSFT. I wonder if this really means that OpenAI is accepting the risk/capital expense while providing a variety of hardware to Microsoft, or if there are other terms at play.
- latchkey 2y ago
  It is just more of this... https://www.amd.com/en/newsroom/press-releases/2024-5-21-amd-instinct-mi300x-accelerators-power-microsoft-a.html https://www.amd.com/en/newsroom/press-releases/2024-5-21-amd...
- buildbot 2y ago
  That's interesting given Microsoft also has it's own accelerator, Maia...
bloodyplonker22 2y ago
That is exactly what the execs at my company are telling us when asked about not using Nvidia -- diversifying away. It's funny though because we have no Nvidia for training at all. We use Trainium because we could not get our hands on Nvidia.
- latchkey 2y ago
  I'm guessing you also got some free/discounted credits? Not sure of the pricing, but the performance of their chip is pretty outdated at this point. MI300x is way faster and more memory.
sirspacey 2y ago
In a data center context?
- latchkey 2y ago
  I think I get what you're saying. That a datacenter probably just wants to focus on one product at a time. You're right, it is simpler. On the other hand, that's part of why neoclouds are sprouting up. Users are asking for the optionality.

vineyardmike 2y ago

> Diversifying away from a single source for all of AI hardware and software, is a smart thing to do. I wonder how this squares with the exclusivity contract with Microsoft. Even the OpenAI/Oracle deal requires Oracle to run Azure stack on their datacenter so MSFT can mediate the relationship. The AMD chips mentioned are also purchased by MSFT. I wonder if this really means that OpenAI is accepting the risk/capital expense while providing a variety of hardware to Microsoft, or if there are other terms at play.

latchkey 2y ago
It is just more of this... https://www.amd.com/en/newsroom/press-releases/2024-5-21-amd-instinct-mi300x-accelerators-power-microsoft-a.html https://www.amd.com/en/newsroom/press-releases/2024-5-21-amd...
buildbot 2y ago
That's interesting given Microsoft also has it's own accelerator, Maia...

bloodyplonker22 2y ago

That is exactly what the execs at my company are telling us when asked about not using Nvidia -- diversifying away. It's funny though because we have no Nvidia for training at all. We use Trainium because we could not get our hands on Nvidia.

latchkey 2y ago
I'm guessing you also got some free/discounted credits? Not sure of the pricing, but the performance of their chip is pretty outdated at this point. MI300x is way faster and more memory.

sirspacey 2y ago

In a data center context?

latchkey 2y ago
I think I get what you're saying. That a datacenter probably just wants to focus on one product at a time. You're right, it is simpler. On the other hand, that's part of why neoclouds are sprouting up. Users are asking for the optionality.