4 ms·

I suppose this is one of the reasons (besides AMD dropping the ball) they aren't even trying to be competitive in the gaming market - they can sell the same mm2

I suppose this is one of the reasons (besides AMD dropping the ball) they aren't even trying to be competitive in the gaming market - they can sell the same mm2 silicon area for much more to AI startups: "There's a full blown run on GPU compute on a level I think people do not fully comprehend right now. Holy cow. I've talked to a lot of vendors in the last 7 days. It's crazy out there y'all. NVIDIA allegedly has sold out its whole supply through the year. So at this point, everyone is just maximizing their LTVs and NVIDIA is choosing who gets what as it fulfills the order queue." [0] [0] https://twitter.com/Suhail/status/1683642991490269185 https://twitter.com/Suhail/status/1683642991490269185

andrewstuart 3y ago
Suhail lacks wisdom. Stop obsessing about cloud GPUs. Go buy retail GPUs. Make them work. Adapt your software. Whatever, stop whining about cloud GPUs just switch to retail. Solve the barriers/limitations. This has been the essences of computing for 60 years. Stop being intimidated by Nvidia. Get your job done in what is available. Buy AMD, buy Intel. Work out how to make your GPU thing work on them. Stop wringing your hands about how there’s no cloud GPUs when there’s a ton of cheap retail GPUs. INNOVATE. Look beyond nvidia. Stop whining. If you’ve bet your entire business on cloud GPUs then you’re a fool. Bet on retail GPUs.
- cosentiyes 3y ago
  > Solve the barriers/limitations I don't think this is possible when you can't pool memory on the 40 series retail GPUs.
- oskarw85 3y ago
  >Stop wringing your hands about how there’s no cloud GPUs when there’s a ton of cheap retail GPUs. See your R&D investment goes up in flames after driver update to block such workload.
  - nl 3y ago
    There's something to this. But also... don't update drivers and accept you are missing out on updates that might also be useful.
- epups 3y ago
  Ok, so make an enormous capital investment in tech that will be outdated in two years - if not already outdated, as you mentioned AMD and Intel. Then, I'll need to hire geniuses who can extract juice out of this hardware at a scale that not even Google, Amazon, Microsoft and others could. Or, I rent just as much top performance hardware as I need, scaling as I go along, and worry about execution and implementation of my niche application instead. You can see why cloud is winning right now.
  - andrewstuart 3y ago
    Except as the previous post points out, you can’t get cloud GPUs.
    - epups 3y ago
      No it doesn't, and yes you can.
    - nl 3y ago
      You can't buy GPUs to build your own cloud. You can access cloud GPUs via the ones that NVidia is selling to.
- wing-_-nuts 3y ago
  >Stop obsessing about cloud GPUs. >Go buy retail GPUs. If you're doing this professionally, you know what you need and what your budget is. If you're doing this personally, to simply learn? I did the math for myself and figured I could probably buy enough gpu credits for the cost of a 4090 build that it would probably serve me all the way through getting a phd.

andrewstuart 3y ago

Suhail lacks wisdom. Stop obsessing about cloud GPUs. Go buy retail GPUs. Make them work. Adapt your software. Whatever, stop whining about cloud GPUs just switch to retail. Solve the barriers/limitations. This has been the essences of computing for 60 years. Stop being intimidated by Nvidia. Get your job done in what is available. Buy AMD, buy Intel. Work out how to make your GPU thing work on them. Stop wringing your hands about how there’s no cloud GPUs when there’s a ton of cheap retail GPUs. INNOVATE. Look beyond nvidia. Stop whining. If you’ve bet your entire business on cloud GPUs then you’re a fool. Bet on retail GPUs.

cosentiyes 3y ago
> Solve the barriers/limitations I don't think this is possible when you can't pool memory on the 40 series retail GPUs.
oskarw85 3y ago
>Stop wringing your hands about how there’s no cloud GPUs when there’s a ton of cheap retail GPUs. See your R&D investment goes up in flames after driver update to block such workload.
- nl 3y ago
  There's something to this. But also... don't update drivers and accept you are missing out on updates that might also be useful.
epups 3y ago
Ok, so make an enormous capital investment in tech that will be outdated in two years - if not already outdated, as you mentioned AMD and Intel. Then, I'll need to hire geniuses who can extract juice out of this hardware at a scale that not even Google, Amazon, Microsoft and others could. Or, I rent just as much top performance hardware as I need, scaling as I go along, and worry about execution and implementation of my niche application instead. You can see why cloud is winning right now.
- andrewstuart 3y ago
  Except as the previous post points out, you can’t get cloud GPUs.
  - epups 3y ago
    No it doesn't, and yes you can.
  - nl 3y ago
    You can't buy GPUs to build your own cloud. You can access cloud GPUs via the ones that NVidia is selling to.
wing-_-nuts 3y ago
>Stop obsessing about cloud GPUs. >Go buy retail GPUs. If you're doing this professionally, you know what you need and what your budget is. If you're doing this personally, to simply learn? I did the math for myself and figured I could probably buy enough gpu credits for the cost of a 4090 build that it would probably serve me all the way through getting a phd.