4 ms·

At the risk of sounding like a broken record: Once others get their software shit together, they can have some of those profits. Nvidia has had a competent soft

At the risk of sounding like a broken record: Once others get their software shit together, they can have some of those profits. Nvidia has had a competent software game for a decade.

LoganDark 3y ago
They still haven't gotten their hardware shit together. As a consumer I can't buy a PCIe card that slots into my system with more than 24GB of VRAM, whether it's from Nvidia, AMD, or Intel. Nvidia's prices will continue to be high while there is literally no competition. I guess before datacenter class cards can trickle down to the consumer, they do have to get their software shit together first.
- kcb 3y ago
  https://www.bhphotovideo.com/c/product/1753962-REG/pny_vcnrtx6000ada_pb_rtx_6000_ada_generation.html/?ap=y&ap=y&smp=y&smp=y&smpm=ba_f2_lar&lsft=BI%3A6879&gad_source=1 https://www.bhphotovideo.com/c/product/1753962-REG/pny_vcnrt...
- my123 3y ago
  NVIDIA and AMD both have workstation PCIe cards with more than 24GB or VRAM (W7900 from AMD and RTX 6000 Ada both have 48GB). They just want more money.
  - LoganDark 3y ago
    Cool. Where can I buy one? If I go to the page for the W7900, I can download the datasheet. I can look at the marketing pages. I can look at the specifications and download drivers. But I can't buy the card. If I look for one on eBay, they start at $4600, which is still far too expensive for 48GB. At that point, just buy an Apple Silicon machine and you can get far more memory than that for even cheaper. (M3 Max MacBook Pro with 96GB memory is just $4,000!) Alright, let's try the RTX A6000! Oop, it's $4,000. Cheaper than AMD, but wow! Oh, and I can only find these prices on eBay, you can't buy them direct from Nvidia as a consumer.
    - NilMostChill 3y ago
      Just checking here but are you comparing a macbook with 96GB of machine RAM to a GPU with 48GB of on-card RAM? Because if so you can get a good pc with 96GB of machine ram for significantly less than $4000. Unless the claim is that an M3 Max MacBook has equivalent GPU type compute power as a dedicated GPU?
      - o_x 3y ago
        It's probably because of the unified memory model - the GPU on the macbook can access the memory as if it was dedicated.
        NilMostChill 3y ago
        Interesting, i didn't know this existed.
      - LoganDark 3y ago
        I'm comparing the cost of a GPU with 48GB VRAM to the cost of an Apple Silicon machine with at least 48GB of Unified Memory, yes. (The ASi machine having 96GB of memory instead is just because it's still cheaper than the card, so why not.) A normal PC with 96GB of regular RAM wouldn't allow you to use that RAM for GPU workloads, at least not with a dedicated GPU.
        NilMostChill 3y ago
        As stated above, i didn't know this existed. Would an ASi machine and Dedicated GPU with the same amount of respective RAM have the same performance compute-wise?
        LoganDark 3y ago
        > As stated above, i didn't know this existed. My comment was made 10 hours before that reply, so I didn't have that context. Sorry. > Would an ASi machine and Dedicated GPU with the same amount of respective RAM have the same performance compute-wise? Not sure, but performance comes after making sure you have enough VRAM to run your workload in the first place. I doubt an ASi chip would beat most datacenter-class training cards, but if a consumer just wants to train a model locally without much regard for getting the best possible performance, there is more value-for-money.

At the risk of sounding like a broken record: Once others get their software shit together, they can have some of those profits. Nvidia has had a competent software game for a decade.

LoganDark 3y ago

They still haven't gotten their hardware shit together. As a consumer I can't buy a PCIe card that slots into my system with more than 24GB of VRAM, whether it's from Nvidia, AMD, or Intel. Nvidia's prices will continue to be high while there is literally no competition. I guess before datacenter class cards can trickle down to the consumer, they do have to get their software shit together first.

kcb 3y ago
https://www.bhphotovideo.com/c/product/1753962-REG/pny_vcnrtx6000ada_pb_rtx_6000_ada_generation.html/?ap=y&ap=y&smp=y&smp=y&smpm=ba_f2_lar&lsft=BI%3A6879&gad_source=1 https://www.bhphotovideo.com/c/product/1753962-REG/pny_vcnrt...
my123 3y ago
NVIDIA and AMD both have workstation PCIe cards with more than 24GB or VRAM (W7900 from AMD and RTX 6000 Ada both have 48GB). They just want more money.
- LoganDark 3y ago
  Cool. Where can I buy one? If I go to the page for the W7900, I can download the datasheet. I can look at the marketing pages. I can look at the specifications and download drivers. But I can't buy the card. If I look for one on eBay, they start at $4600, which is still far too expensive for 48GB. At that point, just buy an Apple Silicon machine and you can get far more memory than that for even cheaper. (M3 Max MacBook Pro with 96GB memory is just $4,000!) Alright, let's try the RTX A6000! Oop, it's $4,000. Cheaper than AMD, but wow! Oh, and I can only find these prices on eBay, you can't buy them direct from Nvidia as a consumer.
  - NilMostChill 3y ago
    Just checking here but are you comparing a macbook with 96GB of machine RAM to a GPU with 48GB of on-card RAM? Because if so you can get a good pc with 96GB of machine ram for significantly less than $4000. Unless the claim is that an M3 Max MacBook has equivalent GPU type compute power as a dedicated GPU?
    - o_x 3y ago
      It's probably because of the unified memory model - the GPU on the macbook can access the memory as if it was dedicated.
      - NilMostChill 3y ago
        Interesting, i didn't know this existed.
    - LoganDark 3y ago
      I'm comparing the cost of a GPU with 48GB VRAM to the cost of an Apple Silicon machine with at least 48GB of Unified Memory, yes. (The ASi machine having 96GB of memory instead is just because it's still cheaper than the card, so why not.) A normal PC with 96GB of regular RAM wouldn't allow you to use that RAM for GPU workloads, at least not with a dedicated GPU.
      - NilMostChill 3y ago
        As stated above, i didn't know this existed. Would an ASi machine and Dedicated GPU with the same amount of respective RAM have the same performance compute-wise?
        LoganDark 3y ago
        > As stated above, i didn't know this existed. My comment was made 10 hours before that reply, so I didn't have that context. Sorry. > Would an ASi machine and Dedicated GPU with the same amount of respective RAM have the same performance compute-wise? Not sure, but performance comes after making sure you have enough VRAM to run your workload in the first place. I doubt an ASi chip would beat most datacenter-class training cards, but if a consumer just wants to train a model locally without much regard for getting the best possible performance, there is more value-for-money.