3 ms·

Also, can I even buy an AMD GPU? I don't see a "buy now" button or a PCIe version anywhere here https://www.amd.com/en/products/accelerators/instinct/mi300/mi3

by dheera 2y ago

Also, can I even buy an AMD GPU? I don't see a "buy now" button or a PCIe version anywhere here https://www.amd.com/en/products/accelerators/instinct/mi300/mi300x.html https://www.amd.com/en/products/accelerators/instinct/mi300/... Another big AMD fuckup in my opinion. Nobody is going to drop millions on these things without being able to test them out first. First rule of sales: If you have something for sale, take my money.

nwiswell 2y ago
> I don't see a "buy now" button or a PCIe version anywhere here "Buy now" buttons and online shopping carts are not generally how organizations looking to spend serious money on AI buy their hardware. They have a long list of server hardware partners, and odds are you'd already have an existing relationship with one or more of them, and they'd provide a quote. They even go one step further and show off some of their partners' solutions: https://www.amd.com/en/graphics/servers-instinct-deep-learning https://www.amd.com/en/graphics/servers-instinct-deep-learni... FWIW I believe Supermicro and Exxact actually do have web-based shopping carts these days, so maybe you could skip the quotation and buy directly if you were so motivated? Seems kind of weird at this price point. https://www.exxactcorp.com/Exxact-TS4-185328443-E185328443 https://www.exxactcorp.com/Exxact-TS4-185328443-E185328443
- dheera 2y ago
  ... and that's why AMD is losing. They could break the trend and offer a "buy now" button instead of offering quotes and coffee chats. It's very likely that will kickstart the software snowball with early adopters. Nobody is going to drop millions on an unproven platform. > Seems kind of weird at this price point. Yeah that $234K server is too much for people to do a trial. It has 8xMI300X GPUs along with a bunch of other shit. Give me a single MI300X GPU in PCIe form factor for $20K and I'd very seriously consider. I'm sure there are many people who would help adapt the ecosystem if they were truly available.
  - nwiswell 2y ago
    Why would you be looking to dip your toe into the AMD ecosystem for the first time using an MI300X? It doesn't make any sense. It's not entry level hardware.
    - dheera 2y ago
      To help fix the ecosystem. It's way more affordable than Nvidia. I'm not looking for entry level hardware.
      - nwiswell 2y ago
        Yes, that's why you'd choose AMD, I'm saying that you don't enter the ecosystem for the first time by purchasing the absolute cutting edge hardware. As far as I'm aware you can't simply buy an Nvidia B200 PCIe card over the counter, either.
        dheera 2y ago
        I'm not looking to enter the ecosystem, I'm already deep in it and want to fix the AMD problem so that I can build big projects around it and undercut everyone who's using Nvidia. You can purchase H100 and A100 PCIe cards over the counter. They're great for compiling CUDA code, testing code before you launch a multi-node job into a cluster, and for running evaluations. AMD has nothing of the sort, and it's hurting them. I cannot blow 250K on an SMCI server, nor do I have the electricity setup for it. I can blow 20K on a PCIe GPU and start contributing to the ecosystem, or maybe prove out an idea on one GPU before trying to raise millions from a VC to build a more cost-effective datacenter that actually works.
        nwiswell 2y ago
        > AMD has nothing of the sort, and it's hurting them. What are you talking about? Have you looked? https://www.dell.com/en-us/shop/amd-mi210-300w-pcie-64gb-passive-double-wide-full-height-gpu-customer-install/apd/490-bhur/ https://www.dell.com/en-us/shop/amd-mi210-300w-pcie-64gb-pas... https://www.bitworks.io/product/amd-instinct-mi210-64gb-hbm2e-graphics-card-2x-slot-pcie-passive-cooling/ https://www.bitworks.io/product/amd-instinct-mi210-64gb-hbm2...

by dheera 2y ago

nwiswell 2y ago

> I don't see a "buy now" button or a PCIe version anywhere here "Buy now" buttons and online shopping carts are not generally how organizations looking to spend serious money on AI buy their hardware. They have a long list of server hardware partners, and odds are you'd already have an existing relationship with one or more of them, and they'd provide a quote. They even go one step further and show off some of their partners' solutions: https://www.amd.com/en/graphics/servers-instinct-deep-learning https://www.amd.com/en/graphics/servers-instinct-deep-learni... FWIW I believe Supermicro and Exxact actually do have web-based shopping carts these days, so maybe you could skip the quotation and buy directly if you were so motivated? Seems kind of weird at this price point. https://www.exxactcorp.com/Exxact-TS4-185328443-E185328443 https://www.exxactcorp.com/Exxact-TS4-185328443-E185328443

dheera 2y ago
... and that's why AMD is losing. They could break the trend and offer a "buy now" button instead of offering quotes and coffee chats. It's very likely that will kickstart the software snowball with early adopters. Nobody is going to drop millions on an unproven platform. > Seems kind of weird at this price point. Yeah that $234K server is too much for people to do a trial. It has 8xMI300X GPUs along with a bunch of other shit. Give me a single MI300X GPU in PCIe form factor for $20K and I'd very seriously consider. I'm sure there are many people who would help adapt the ecosystem if they were truly available.
- nwiswell 2y ago
  Why would you be looking to dip your toe into the AMD ecosystem for the first time using an MI300X? It doesn't make any sense. It's not entry level hardware.
  - dheera 2y ago
    To help fix the ecosystem. It's way more affordable than Nvidia. I'm not looking for entry level hardware.
    - nwiswell 2y ago
      Yes, that's why you'd choose AMD, I'm saying that you don't enter the ecosystem for the first time by purchasing the absolute cutting edge hardware. As far as I'm aware you can't simply buy an Nvidia B200 PCIe card over the counter, either.
      - dheera 2y ago
        I'm not looking to enter the ecosystem, I'm already deep in it and want to fix the AMD problem so that I can build big projects around it and undercut everyone who's using Nvidia. You can purchase H100 and A100 PCIe cards over the counter. They're great for compiling CUDA code, testing code before you launch a multi-node job into a cluster, and for running evaluations. AMD has nothing of the sort, and it's hurting them. I cannot blow 250K on an SMCI server, nor do I have the electricity setup for it. I can blow 20K on a PCIe GPU and start contributing to the ecosystem, or maybe prove out an idea on one GPU before trying to raise millions from a VC to build a more cost-effective datacenter that actually works.
        nwiswell 2y ago
        > AMD has nothing of the sort, and it's hurting them. What are you talking about? Have you looked? https://www.dell.com/en-us/shop/amd-mi210-300w-pcie-64gb-passive-double-wide-full-height-gpu-customer-install/apd/490-bhur/ https://www.dell.com/en-us/shop/amd-mi210-300w-pcie-64gb-pas... https://www.bitworks.io/product/amd-instinct-mi210-64gb-hbm2e-graphics-card-2x-slot-pcie-passive-cooling/ https://www.bitworks.io/product/amd-instinct-mi210-64gb-hbm2...