4 ms·

So the 300A is an accelerator coupled with a full 24-core EPYC and 128GB of HBM all on a single chip (or, packaged chiplets, whatever). Why is it I can't buy a

So the 300A is an accelerator coupled with a full 24-core EPYC and 128GB of HBM all on a single chip (or, packaged chiplets, whatever). Why is it I can't buy a single one of these, on a motherboard, in a workstation format case, to use as an insane workstation? Assuming you could program for the accelerator part, there is an entire world of x86-fixed CAD, engineering, and entertainment industry (rendering, etc) where people want a single, desktop machine with 128GB + of fast ram to number crunch. There are Blender artists out there that build dual and quad RTX4090 machines with Threadrippers for $20k+ in components all day, because their render jobs pay for it. There are engineering companies that would not bat an eye at dropping $30k on a workstation if it mean they could spin around 80 gigabyte CATIA models of cars or aircraft loaded in RAM quicker. I know this at least because I sure as hell did with with several HP Z-series machines costing whole-Toyota-Corolla prices over the years... But these combined APU chips are relegated to these server units. In the end is this a driver problem? Just a software problem? A chicken and egg problem where no one is developing the support because there isn't the hardware on the market, and there isn't the hardware on the market because AMD thinks there is no use case? Edit: and note my use cases mentioned don't rely on latency, really, like videogamers need to hit framerates. The cache miss latency mentioned in the article doesn't matter as much for these type of compute applications where the main problems are just loading and unloading the massive amount of data. Things like offline renders and post-processing CFD simulations. Not necessarily a video output framerate.

latchkey 2y ago
(I run a company that buys MI300x.) > Why is it I can't buy a single one of these, on a motherboard, in a workstation format case, to use as an insane workstation? AMD doesn't have the resources to support end users for something like this. They are a public company, look at their spend. They are pouring everything they've got into trying to keep up with the Nvidia release cycle for AI chips. These chips are cutting edge, they are not perfect. They are still working through the hardware and software issues. It is hard enough to deal with all the public opinion on things as it is. Why would they add another layer of potential abuse?
- AnthonyMouse 2y ago
  The people who buy stuff like that are professionals. They often know something about the tools they're using and if there are any problems, provide bug reports that actually describe what's happening instead of some non-descriptive mush like "I have your GPU and Windows crashes sometimes". That is extremely helpful if you're trying to get rid of those bugs. This is the same reason software shops have found it useful to support Linux, even if not many people use it. The people who do will make your product suck less, which in turn makes it easier to sell to the mass market, which will get upset and think unfavorably of you if they have the same problem but not be as good at telling you about it.
  - Aurornis 2y ago
    > provide bug reports that actually describe what's happening Doesn’t matter if the bug reports are good or bad. Supporting low volume applications is a bad business move when the alternative is 9-figure data center contracts. The data center business is orders of magnitude larger. Trying to support individual developers would be a huge business mistake when they already can’t keep up with data center.
    - AnthonyMouse 2y ago
      It's the same hardware running the same software. You want the bug reports so you can fix them and then your data center customers don't encounter them when they're evaluating your product. What they can keep up with is basically a matter of how much capacity they order from TSMC. If they underestimated demand for some generation, that's the sort of thing you fix with the next contract or you're just throwing money away.
  - latchkey 2y ago
    Groq is a good example here: https://www.eetimes.com/groq-ceo-we-no-longer-sell-hardware/ https://www.eetimes.com/groq-ceo-we-no-longer-sell-hardware/ Our users give them plenty of feedback. They just RMA'd whole bunch of our GPUs over this issue so that they could take them back to the mothership and figure out what's up... https://github.com/ROCm/ROCm/issues/4021 https://github.com/ROCm/ROCm/issues/4021 It takes a lot of coordination, across ourselves (with customers), our DC, AMD and Dell to make that happen.
Aurornis 2y ago
Data center orders are high volume and allow long lead times. You can collect orders, collect money, and then agree when to deliver huge batches of product. Selling one off chips isn’t attractive at all in this context. Selling a couple parts to the rare Blender artist is nothing relative to the data center buildouts with billion dollar budgets. Every one-off part you sell takes resources and inventory away from landing those big contracts.
bluedino 2y ago
Does AMD build a DGX-like device? https://www.nvidia.com/en-us/data-center/dgx-platform/?ncid=pa-srch-goog-125782 https://www.nvidia.com/en-us/data-center/dgx-platform/?ncid=... We are trialing some AMD GPUs right now, otherwise we are all NVIDIA.
JonChesterfield 2y ago
Supermicro sell them, https://www.supermicro.com/en/accelerators/amd https://www.supermicro.com/en/accelerators/amd. Other companies probably do too. I'm excited about the ~100W class APUs just announced at CES, hoping for one in a vesa mount format.

latchkey 2y ago

(I run a company that buys MI300x.) > Why is it I can't buy a single one of these, on a motherboard, in a workstation format case, to use as an insane workstation? AMD doesn't have the resources to support end users for something like this. They are a public company, look at their spend. They are pouring everything they've got into trying to keep up with the Nvidia release cycle for AI chips. These chips are cutting edge, they are not perfect. They are still working through the hardware and software issues. It is hard enough to deal with all the public opinion on things as it is. Why would they add another layer of potential abuse?

AnthonyMouse 2y ago
The people who buy stuff like that are professionals. They often know something about the tools they're using and if there are any problems, provide bug reports that actually describe what's happening instead of some non-descriptive mush like "I have your GPU and Windows crashes sometimes". That is extremely helpful if you're trying to get rid of those bugs. This is the same reason software shops have found it useful to support Linux, even if not many people use it. The people who do will make your product suck less, which in turn makes it easier to sell to the mass market, which will get upset and think unfavorably of you if they have the same problem but not be as good at telling you about it.
- Aurornis 2y ago
  > provide bug reports that actually describe what's happening Doesn’t matter if the bug reports are good or bad. Supporting low volume applications is a bad business move when the alternative is 9-figure data center contracts. The data center business is orders of magnitude larger. Trying to support individual developers would be a huge business mistake when they already can’t keep up with data center.
  - AnthonyMouse 2y ago
    It's the same hardware running the same software. You want the bug reports so you can fix them and then your data center customers don't encounter them when they're evaluating your product. What they can keep up with is basically a matter of how much capacity they order from TSMC. If they underestimated demand for some generation, that's the sort of thing you fix with the next contract or you're just throwing money away.
- latchkey 2y ago
  Groq is a good example here: https://www.eetimes.com/groq-ceo-we-no-longer-sell-hardware/ https://www.eetimes.com/groq-ceo-we-no-longer-sell-hardware/ Our users give them plenty of feedback. They just RMA'd whole bunch of our GPUs over this issue so that they could take them back to the mothership and figure out what's up... https://github.com/ROCm/ROCm/issues/4021 https://github.com/ROCm/ROCm/issues/4021 It takes a lot of coordination, across ourselves (with customers), our DC, AMD and Dell to make that happen.

Aurornis 2y ago

Data center orders are high volume and allow long lead times. You can collect orders, collect money, and then agree when to deliver huge batches of product. Selling one off chips isn’t attractive at all in this context. Selling a couple parts to the rare Blender artist is nothing relative to the data center buildouts with billion dollar budgets. Every one-off part you sell takes resources and inventory away from landing those big contracts.

bluedino 2y ago

Does AMD build a DGX-like device? https://www.nvidia.com/en-us/data-center/dgx-platform/?ncid=pa-srch-goog-125782 https://www.nvidia.com/en-us/data-center/dgx-platform/?ncid=... We are trialing some AMD GPUs right now, otherwise we are all NVIDIA.

JonChesterfield 2y ago

Supermicro sell them, https://www.supermicro.com/en/accelerators/amd https://www.supermicro.com/en/accelerators/amd. Other companies probably do too. I'm excited about the ~100W class APUs just announced at CES, hoping for one in a vesa mount format.