5 ms·
Last paragraph is informative: > Anthropic relies heavily on a combination of chips designed by Amazon Web Services known as Trainium, as well as Google’s in-h
by jt2190 9mo ago
Last paragraph is informative:
> Anthropic relies heavily on a combination of chips designed by Amazon Web Services known as Trainium, as well as Google’s in-house designed TPU processors, to train its AI models. Google largely uses its TPUs to train Gemini. Both chips represent major competitive threats to Nvidia’s best-selling products, known as graphics processing units, or GPUs.
So which leading AI company is going to build on Nvidia, if not OpenAI?
- dylan604 9mo agoWould Nvidia investing heavily in ClosedAI dissuade others to use Nvidia?
- smileson2 9mo agoAren't they switching to PI for Pretend Intelligence?
- irishcoffee 9mo agoIf nothing else, the video game market would explode under AMD, maybe?
- wmf 9mo agoOpenAI will keep using Nvidia GPUs but they may have to actually pay for them.
- dfajgljsldkjag 9mo agothe chinese will probably figure out a way to sneak the nvidia chips around the sanctions
- ekianjo 9mo agoAlibaba has their own chips now they use for training.
- Morromist 9mo agoNvidia had the chance to build its own AI software and chose not to. It was a good choice so far, better to sell shovels than go to the mines - but they still could go mining if the other miners start making their own shovels. If I were Nvidia I would be hedging my bets a little. OpenAI looks like it's on shaky ground, it might not be around in a few years.
- snypher 9mo agoAnother comment had this: https://blogs.nvidia.com/blog/open-models-data-tools-accelerate-ai/ https://blogs.nvidia.com/blog/open-models-data-tools-acceler... Interesting times.
- Morromist 9mo agoGood point, I didn't notice that. Interesting times indeed!
- system2 9mo agoThere is no way Nvidia can make even a fraction of what they are making from AI software.
- vessenes 9mo agoThey do build their own software, though. They have a large body of stuff they make. My guess is that it’s done to stay current, inform design and performance, and to have something to sell enterprises along with the hardware; they have purposely not gone after large consumer markets with their model offerings as far as I can tell.
- paxys 9mo ago"Largely" is doing a lot of heavy lifting here. Yes Google and Amazon are making their own GPU chips, but they are also buying as many Nvidia chips as they can get their hands on. As are Microsoft, Meta, xAI, Tesla, Oracle and everyone else.
- greiskul 9mo agoBut is Google buying those GPU chips for their own use, or to have them on their data centers for their cloud customers?
- dekhn 9mo agogoogle buys nvidia GPUs for cloud, I don't think they use them much or at all internally. The TPUs are both used internally, and in cloud, and now it looks like they are delivering them to customers in their own data centers.
- moralestapia 9mo agoI can see them being used for training if they're vacant.
- HarHarVeryFunny 9mo agoThe various AI accelerator chips, such as TPUs and NVidia GPUs, are only compatible to extent that some of the high level tools like PyTorch and Triton (kernel compiler) may support both, which is like saying that x86 and ARM chips are compatible since gcc supports them both as targets, but note this does not mean that you can take a binary compiled for ARM and run it on an x86 processor. For these massive, and expensive to train, AI models the differences hit harder since at the kernel level, where the pedal hits the metal, they are going to be wringing every last dollar of performance out of the chips by writing hand optimized kernels for them, highly customized to the chip's architecture and performance characteristics. It may go deeper than that too, with the detailed architecture of the models themselves tweaked to best perform on a specific chip. So, bottom line is that you can't just take a model "compiled to run on TPUs", and train it on NVidia chips just because you have spare capacity there.
- nick49488171 9mo agoMaybe xAI/Tesla, Meta, Palantir
- raincole 9mo agoLiterally all the other companies that still believe they can be the leading ones one day?
- lofaszvanitt 9mo agoThe moment you threaten NVDA's livelyhood, your company starts to fall apart. History tells.
- mcintyre1994 9mo agoThat’s interesting, I didn’t know that about Anthropic. I guess it wouldn’t really make sense to compete with OpenAI and everyone else for Nvidia chips if they can avoid it.
- rvz 9mo agoIt's almost as if everyone here was assuming that Nvidia would have no competition for a long time, but it has been known for a long time, there are many competitors coming after their data center revenues. [0] > So which leading AI company is going to build on Nvidia, if not OpenAI? It's xAI. But what matters is that there is more competition for Nvidia and they bought Groq to reduce that. OpenAI is building their own chips as well as Meta. The real question is this: What happens when the competition catches up with Nvidia and takes a significant slice out of their data center revenues? [0] https://news.ycombinator.com/item?id=45429514 https://news.ycombinator.com/item?id=45429514
- papichulo2023 9mo agoThe elephant in the room is China also being partially successful with their chips