4 ms·
According to Observer they are: Microsoft, Meta, Google, and Amazon. Other big buyers area: Oracle, CoreWeave, Lambda, Tencent, Baidu, Alibaba, ByteDance, Tesl
by andsoitis 2y ago
According to Observer they are: Microsoft, Meta, Google, and Amazon.
Other big buyers area: Oracle, CoreWeave, Lambda, Tencent, Baidu, Alibaba, ByteDance, Tesla, xAI.
https://observer.com/2024/06/nvidia-largest-ai-chip-customers/ https://observer.com/2024/06/nvidia-largest-ai-chip-customer...
- thereisnospork 2y agoKind of embarrassing for Google to be on that list, no? Shouldn't their in-house TPUs be cost-advantageous for them?
- bayindirh 2y agoNo, because GPUs are not only for AI. They are MATMUL machines, and MATMUL is useful way beyond AI and tensor applications. Some of us use them at double precision mode.
- lolinder 2y agoYes, but demand for these chips went through the roof because of AI. If Google is on this list it's because they're using them for AI, not because they've got a secret project rendering an insane number of 3D images or something.
- bayindirh 2y agoEverything from material simulation to weather forecasts use GPUs very actively and effectively, for a long time. There’s a whole world using GPUs to accelerate things.
- lolinder 2y agoRight, I'm not arguing against that. I'm saying that Meta and Amazon and Microsoft are all buying these chips in insane numbers for AI—their usage for all other types of GPU activity is at least an order of magnitude less. That's why Nvidia skyrocketed to become the most valuable company over just a few years. For Google to be on that short list of whales would either mean that they for some reason have a much larger demand for GPUs for non-AI purposes than any of the others have for AI purposes (doubtful) or that they're using GPUs for AI.
- deleted 2y ago[deleted]
- nomad_horse 2y agoThose are likely for Cloud, used by clients.
- dagmx 2y agoGoogle has addressed this. They offer GCP as an AWs alternate. They’d rather offer their clients what they need than push them on to their own products.
- thereisnospork 2y agoI understand why the state of affairs is, the point is that it's pathetic. Google, an AI hardware manufacturer[0], has to eat a direct competitors not in substantial margins in order to offer their customers, external and internal, a viable product. [0]and supposed software powerhouse.
- dagmx 2y agoMicrosoft has Linux on Azure. Amazon doesn’t force everyone onto graviton cores, and offers competing cores. It’s just the nature of business.
- ksec 2y agoAt one point over 50% of their server revenue came from hyperscaler. Which is exactly the same as those four listed.
- purplerabbit 2y ago"Who could it be... Hmm... Such a tough nut to crack..." (Even without a report on this it would be obvious)
- deleted 2y ago[deleted]
- paulddraper 2y agoUtterly surprising
- darth_avocado 2y agoMeta can be confirmed as one since they’ve literally mentioned their infra investments and Billions in capex increases until the end of 2025 in every earnings call this year.
- bhawks 2y agoI guess Apple is using their custom silicon? That was a major payoff for Apple - I wonder if any of the other fangs will actually be able to follow suit.
- xuancanh 2y agoApple uses TPUs on Google Cloud Platform. https://www.cnbc.com/2024/07/29/apple-says-its-ai-models-were-trained-on-googles-custom-chips-.html https://www.cnbc.com/2024/07/29/apple-says-its-ai-models-wer...
- ceejayoz 2y agoAnd a weird deal with OpenAI (which I think would show up as Microsoft for the actual physical hardware). https://openai.com/index/openai-and-apple-announce-partnership/ https://openai.com/index/openai-and-apple-announce-partnersh...
- SSLy 2y agofor training, but for the interference apparently they use their own chips
- talldayo 2y agoExcept in cases where responses are outsourced from OpenAI. All the ChatGPT-based inference likely happens on Nvidia hardware too.
- bigyikes 2y agoIs there evidence that Apple is training a model large enough to require a huge amount of compute?
- dialup_sounds 2y agohttps://arxiv.org/abs/2407.21075 https://arxiv.org/abs/2407.21075 AFM-server was trained on 8192 TPUv4 chips Someone more versed can say if that is huge or not.
- kklisura 2y agoWhere is Apple in all of this?
- seaal 2y agoApple historically dislikes NVIDIA and I they would likely rather use their own in-house chip team. They also rely on it by virtue of using OpenAI in upcoming iOS release.
- zigzag312 2y agoThey don't like the high margins? :P
- m463 2y agoI wonder if the split happened with jobs or after jobs? I thought jobs was good at relationships with everyone else in silicon valley (intel, ati, nvidia, even microsoft)
- bayindirh 2y agoIIRC it was with Jobs. Apple wanted to develop their own drivers for their chips from ground up, and NVIDIA was very secretive of their tech, so things went south.
- user_7832 2y ago> NVIDIA was very secretive of their tech Oh the irony for Apple to dislike others being secretive...
- bayindirh 2y agoOn their own right, they contribute more than many other companies, though. Their kernel is open source, they have given their secret sauces like Grand Central Dispatch away, allowed complex technologies like mDNS (Bonjour), AirPrint, multipath networking to be implemented freely and used widely in a vendor agnostic manner. macOS is 1000 times better for talking UNIX systems than Windows and is POSIX compliant. Lastly, they are not hindering the development of Asahi Linux, and did nothing when their devices were reverse engineered. On the contrary, they left a couple of ways open for Asahi guys to boot their distribution directly. They are not the band of saints, but they are not the underhanded evils like a couple of others.