4 ms·

Why would you be looking to dip your toe into the AMD ecosystem for the first time using an MI300X? It doesn't make any sense. It's not entry level hardware.

dheera 2y ago
To help fix the ecosystem. It's way more affordable than Nvidia. I'm not looking for entry level hardware.
- nwiswell 2y ago
  Yes, that's why you'd choose AMD, I'm saying that you don't enter the ecosystem for the first time by purchasing the absolute cutting edge hardware. As far as I'm aware you can't simply buy an Nvidia B200 PCIe card over the counter, either.
  - dheera 2y ago
    I'm not looking to enter the ecosystem, I'm already deep in it and want to fix the AMD problem so that I can build big projects around it and undercut everyone who's using Nvidia. You can purchase H100 and A100 PCIe cards over the counter. They're great for compiling CUDA code, testing code before you launch a multi-node job into a cluster, and for running evaluations. AMD has nothing of the sort, and it's hurting them. I cannot blow 250K on an SMCI server, nor do I have the electricity setup for it. I can blow 20K on a PCIe GPU and start contributing to the ecosystem, or maybe prove out an idea on one GPU before trying to raise millions from a VC to build a more cost-effective datacenter that actually works.
    - nwiswell 2y ago
      > AMD has nothing of the sort, and it's hurting them. What are you talking about? Have you looked? https://www.dell.com/en-us/shop/amd-mi210-300w-pcie-64gb-passive-double-wide-full-height-gpu-customer-install/apd/490-bhur/ https://www.dell.com/en-us/shop/amd-mi210-300w-pcie-64gb-pas... https://www.bitworks.io/product/amd-instinct-mi210-64gb-hbm2e-graphics-card-2x-slot-pcie-passive-cooling/ https://www.bitworks.io/product/amd-instinct-mi210-64gb-hbm2...
    - shaklee3 2y ago
      A 20k GPU will be passively cooled and you'll need a real server for that. Even the old MI210 another poster sent is passive.
      - deleted 2y ago
        [deleted]

dheera 2y ago

To help fix the ecosystem. It's way more affordable than Nvidia. I'm not looking for entry level hardware.

nwiswell 2y ago
Yes, that's why you'd choose AMD, I'm saying that you don't enter the ecosystem for the first time by purchasing the absolute cutting edge hardware. As far as I'm aware you can't simply buy an Nvidia B200 PCIe card over the counter, either.
- dheera 2y ago
  I'm not looking to enter the ecosystem, I'm already deep in it and want to fix the AMD problem so that I can build big projects around it and undercut everyone who's using Nvidia. You can purchase H100 and A100 PCIe cards over the counter. They're great for compiling CUDA code, testing code before you launch a multi-node job into a cluster, and for running evaluations. AMD has nothing of the sort, and it's hurting them. I cannot blow 250K on an SMCI server, nor do I have the electricity setup for it. I can blow 20K on a PCIe GPU and start contributing to the ecosystem, or maybe prove out an idea on one GPU before trying to raise millions from a VC to build a more cost-effective datacenter that actually works.
  - nwiswell 2y ago
    > AMD has nothing of the sort, and it's hurting them. What are you talking about? Have you looked? https://www.dell.com/en-us/shop/amd-mi210-300w-pcie-64gb-passive-double-wide-full-height-gpu-customer-install/apd/490-bhur/ https://www.dell.com/en-us/shop/amd-mi210-300w-pcie-64gb-pas... https://www.bitworks.io/product/amd-instinct-mi210-64gb-hbm2e-graphics-card-2x-slot-pcie-passive-cooling/ https://www.bitworks.io/product/amd-instinct-mi210-64gb-hbm2...
  - shaklee3 2y ago
    A 20k GPU will be passively cooled and you'll need a real server for that. Even the old MI210 another poster sent is passive.
    - deleted 2y ago
      [deleted]