5 ms·
So Who Is Building That 100k GPU Cluster for XAI?
- echelon 2y agoLooks like Musk could easily leapfrog OpenAI, Anthropic, and the rest. He was given all the money he needs to catch up and then some. It doesn't look like there are any moats to speak of.
- deleted 2y ago[deleted]
- Havoc 2y ago>Looks like Musk could easily leapfrog OpenAI, Anthropic, and the rest. With a 100k GPUs? I think not. Nvidia shipped 150k+ to both meta and MS each JUST in 2023: https://www.statista.com/statistics/1446564/nvidia-h100-gpu-shipments-by-customer/ https://www.statista.com/statistics/1446564/nvidia-h100-gpu-... Certainly puts him in the running though
- rbanffy 2y agoThey also have the Dojo wafer-scale chips. A different process from the Cerebras one - this is more like a wafer sized interposer with large chipsets. Still pretty cool.
- deleted 2y ago[deleted]
- uncharted9 2y agoCool article from the perspective of setting up a data center, but the big question remains - Why? If the goal is to create a bigger, faster, smarter version of OpenAI's GPT, then I'm not sure if this sounds even logical. The current crop of LLM models is just a Q&A hallucination filled chatbot which are way past their peak hype cycle. There is still no business model or killer product-market fit. I don't know what the investors are expecting, but they are more than willing to throw more than 6B dollars. So idk. °_°
- lagniappe 2y agoDell Specifically, the XE9680 racks ( 8xH100 ). 100k H100 GPU, 300k B200 GPU, liquid cooled doors in the racks, 750 racks, and some other minor details.
- plegresl 2y agoDell is half the racks, the other half are SuperMicro: https://x.com/elonmusk/status/1803429159005241780 https://x.com/elonmusk/status/1803429159005241780
- deleted 2y ago[deleted]
- ethagknight 2y agoI just drove by the site for fun the other day. Probably 500 cars parked out front of workers. They’ve installed what appear to be a 6-8 large gas generators on the north end parking lot to provide more power until they get larger links set up to the new TVA combined cycle gas plant, 1.2 GW facility across the street. That’s about all, onsite. More impressive than that though is the 1000+ acres of empty land going south that is prepped for future industry. As a Memphian, I hope Elon sees the potential to build huge scale stuff here in the future. There’s a huge steel mill, a river terminal for direct access to oversized shipping, a wastewater plant next door, a large Valero oil refinery up the street, and a Canadian National intermodal facility down the road. Literally everything one would need to build millions of robots or trucks or rocket engines or whatever. https://maps.app.goo.gl/NuHUpg6CcndxyKHK9?g_st=com.google.maps.preview.copy https://maps.app.goo.gl/NuHUpg6CcndxyKHK9?g_st=com.google.ma...