4 ms·

Is this a drop in replacement for clouds (which is the actual question to ask because if you are buying this you have to make new infrastructure) the answer is

Is this a drop in replacement for clouds (which is the actual question to ask because if you are buying this you have to make new infrastructure) the answer is No. Will Microsoft and Oracle allow you to use this to rent ? Yes. Does Microsoft and Oracle need more accelerators to do internal business processes? Absolutely (Microsoft announced it would rent AI accelerators because they can’t keep up with their own internal (and maybe external) demand). So cost has to not just be per card but infrastructure build out . Not sure when Microsoft will just have their own TPU accelerator but I wouldn’t be surprised if the announce it sometime.

Der_Einzige 3y ago
Can you cite your claims about Oracle wanting to deploy these? Oracle has a deep partnership with Nvidia to the point that in many cases, they have joint booths at conferences. I was not aware of any efforts to purchase or deploy MI300s at OCI.
- dhruvdh 3y ago
  Oracle were present at the event today and said it themselves. Also, it has been widely reported for months now that this is happening.
- viewtransform 3y ago
  At today's AMD presentation the SVP of Oracle Cloud Infrastructure reveals it. https://youtu.be/tfSZqjxsr0M?t=2006 https://youtu.be/tfSZqjxsr0M?t=2006
  - metadat 3y ago
    There are a lot of SVPs, but this was still helpful, even though Karan is just a small fry! Looking forward to trying out the MI300x.
IceHegel 3y ago
They announced the Maia 100 AI accelerator last month. TSMC N5, 105b transistors. https://news.microsoft.com/source/features/ai/in-house-chips-silicon-to-service-to-meet-ai-demand/ https://news.microsoft.com/source/features/ai/in-house-chips...
dhruvdh 3y ago
The part is OCP compliant and can be drop in. Microsoft has already annouced their "TPU" at Ignite. The amount of misinformation in these threads is driving me insane.
- latchkey 3y ago
  Me too, but you're doing a great job not only responding to things, but also giving more context.

Der_Einzige 3y ago

Can you cite your claims about Oracle wanting to deploy these? Oracle has a deep partnership with Nvidia to the point that in many cases, they have joint booths at conferences. I was not aware of any efforts to purchase or deploy MI300s at OCI.

dhruvdh 3y ago
Oracle were present at the event today and said it themselves. Also, it has been widely reported for months now that this is happening.
viewtransform 3y ago
At today's AMD presentation the SVP of Oracle Cloud Infrastructure reveals it. https://youtu.be/tfSZqjxsr0M?t=2006 https://youtu.be/tfSZqjxsr0M?t=2006
- metadat 3y ago
  There are a lot of SVPs, but this was still helpful, even though Karan is just a small fry! Looking forward to trying out the MI300x.

IceHegel 3y ago

They announced the Maia 100 AI accelerator last month. TSMC N5, 105b transistors. https://news.microsoft.com/source/features/ai/in-house-chips-silicon-to-service-to-meet-ai-demand/ https://news.microsoft.com/source/features/ai/in-house-chips...

dhruvdh 3y ago

The part is OCP compliant and can be drop in. Microsoft has already annouced their "TPU" at Ignite. The amount of misinformation in these threads is driving me insane.

latchkey 3y ago
Me too, but you're doing a great job not only responding to things, but also giving more context.