4 ms·
How are these companies even getting these GPUs? I would imagine NVIDIA would give them all to Microsoft and Google if they are in short supply.
by freeqaz 2y ago
How are these companies even getting these GPUs? I would imagine NVIDIA would give them all to Microsoft and Google if they are in short supply.
- m3kw9 2y agoNvidia needs these alt cloud so when big co builds their own GPUs they have them to suck up supply. If they are all dead, Nvidia may have no back path
- rvba 2y agoWhy couldnt NVIDIA auction some to get best price? I mean locking customers long term is probably better, but a certain % of product still vould be sold for a spot price? This made me wonder what is the optimum split on that - obviously depends on your market placement, but isnt nvidia basically a monopoly now?
- zer00eyz 2y ago> Why couldnt NVIDIA auction some to get best price? Have you seen their pricing? They are robbing everyone and selling out quickly. I don't think "auctions" are going to add much to thee bottom line.
- autoexecbat 2y agoAt some point, nvidia does have to worry about amd getting their act together once they've annoyed all the current customers
- nothercastle 2y agoAmd will never figure out drivers and software stuff. That’s always been their weakness
- Palmik 2y agoMI250 and MI300 are competitive for inference and training. The problem is that there's no cloud with simple registration that offers these for reasonable on demand price. This means that basically no one in the open source AI community can use them, so most development and tooling is being tested and built for NVIDIA.
- latchkey 2y agoI am working on solving that issue with MI300x.
- margorczynski 2y agoI wonder what Lisa tells the shareholders & board when they ask why billions fly past their noses in valuation. Curious why ATI/AMD never could be on par to Nvidia regarding the software stack (drivers mainly), I would assume bad leadership and goals.
- latchkey 2y agoI'd call it a focus on very profitable ventures, like gaming. Nvidia effectively created this AI world by building tooling and software for something we didn't know existed up until not too long ago. AI was created on the shoulders of the work that was done. AMD wasn't taking the risk on the unknown, for whatever reason. Water under the bridge. The ship is certainly busy course correcting now. Give it some time.
- nothercastle 2y agoWell they didn’t have any money. They bet big on cpu r&d and they did great but there wasn’t enough money left over for other moon shoots. AMD was at risk of becoming a failed company not too long ago so they recovered quite well.
- latchkey 2y agoAmd will never have a CPU with more core's than Intel. I'm sure people said that too and look at where we are at today.
- nothercastle 2y agoI don’t think anyone ever said that. Back when amd was lagging badly the core war wasn’t really a thing
- latchkey 2y ago> the core war wasn’t really a thing Core performance has always been a thing.
- oldpersonintx 2y ago[dead]
- mym1990 2y agoI think one of Jensen Huang's big interests is to enable a diverse number of markets that can utilize the technology in a short feedback loop. I don't believe that can be achieved if all of the hardware goes to Microsoft/Google.
- SllX 2y agoIt’s better to have a diversified customer-base rather than being completely beholden to a small number of big customers that might decide they don’t need you down the line.
- rjst01 2y agoIndeed, Google and Amazon have already shown an interest in designing their own silicon (TPU and Graviton). Probably Microsoft too, but I'm not aware of an example off the top of my head. Upstarts are not easily going to be able to pursue that, so NVidia has a strong interest in supporting them.
- SllX 2y agoMicrosoft too: https://www.theverge.com/2023/11/15/23960345/microsoft-cpu-gpu-ai-chips-azure-maia-cobalt-specifications-cloud-infrastructure https://www.theverge.com/2023/11/15/23960345/microsoft-cpu-g...
- yardie 2y agoNvidia is a shovel maker. If you only have 1-2 shovel buyers, buyers who've started on making their own shovels in-house, then you run the risk of being trapped in a monopsony. You lose 1 shovel buying client and then you might be insolvent before too long.
- jedberg 2y agoI head up Product at Lambda. We are an NVIDIA preferred partner (and keep winning the preferred partner award). I don't know what the allocation numbers are for other companies, but we get a lot. It's in NVIDIAs best interest to spread the love around and make sure all the GPUs don't go to the hyperscalers.
- leetharris 2y agoI head engineering at Rev and every time we talk to Nvidia about GPUs they tell us to go to you guys. Every time. They really like Lambda!
- jedberg 2y agoVery happy to hear this!
- tpurves 2y agoI anyone buying AMD MI300? I am curious if anyone is finding AMD, as an alternate GPU vendor, available or useful yet?
- latchkey 2y agoMy company, Hot Aisle, is.
- Palmik 2y agoAre there any plans to support your on demand cloud in the future? In the past few months there are basically no GPUs available. My understanding is that your reserved cloud starts at 64 GPUs (8 pods) and with quite a long reservation time frame.
- jedberg 2y agoWe have new product coming in just a couple weeks to get clusters as small as 16 GPUs per cluster and only a two week minimum reservation, with very short lead times (the first people to reserve will have almost no lead time!). Also we expect to have a bunch of capacity come online of the on-demand cloud this year. We're getting the GPUs as quickly as we can and racking them as quickly as possible, but we have to wait just like everyone else for the GPUs to roll off the fab. :)
- Workaccount2 2y agoGoogle doesn't use nVidia chips, at least for AI. They have their own in house solution.
- FrankPetrilli 2y agohttps://cloud.google.com/compute/docs/gpus#nvidia_gpus_for_compute_workloads https://cloud.google.com/compute/docs/gpus#nvidia_gpus_for_c...
- jeffbee 2y agoCoreWeave does not exactly have an arms-length relationship with nvidia.