3 ms·
from the summary: "When it is all said and done, MI300X is a very impressive piece of hardware. However, the software side suffers from a chicken-and-egg dilem
by pella 2y ago
from the summary:
"When it is all said and done, MI300X is a very impressive piece of hardware. However, the software side suffers from a chicken-and-egg dilemma. Developers are hesitant to invest in a platform with limited adoption, but the platform also depends on their support. Hopefully the software side of the equation gets into ship shape. Should that happen, AMD would be a serious competitor to NVIDIA."
- firebaze 2y agoOTOH, the performance advantage compared to the H100 is super-impressive according to tfa. Things could become interesting again in the GPU market.
- bearjaws 2y agoIMO Nvidia is going to force companies to fix this, Nvidia have always made it clear they will increase prices and capture 90% of your profits when left free to do so. See any example from the GPU vendor space. There isn't infinite money to be spent per token, so it's not like the AI companies can just increase prices. AMD can offer this product at a 40% discount and still make money tells you all you need to know.
- amelius 2y agoI'm personally wondering when nVidia will open an AI AppStore, and every app that runs on nVidia hardware will have to be notarized first, and you'll have to pay 30% of your profits to nVidia. History has shown that this idea is not as crazy as it sounds.
- bearjaws 2y agoOh that is a great example, just wipe out Hugging Face, Ollama, Together.ai, and probably 20 more. They can host it all themselves or require their vendors to lease some time to them at cost..
- deleted 2y ago[deleted]
- autoexecbat 2y agoAMD should be giving out these units to whichever clouds are willing to host them, so they can get them in the hands of developers to induce demand via working software
- latchkey 2y agoYou are totally right.