4 ms·
$45 billion for a 3 year rental.
by gjsman-1000 6mo ago
$45 billion for a 3 year rental.
- thetrb 6mo agohow much did SpaceX / xAI pay for these GPUs? After 3 years they'll probably be mostly deprecated.
- electriclove 6mo agoAre GPUs from 3 years ago being deprecated today?
- 3eb7988a1663 6mo agoI thought I saw a report from someone at Google saying that they were still running 7+ year old hardware because of demand. Even if it is not state of the art, if it generates more than the electricity costs, keep it running until it dies.
- WarmWash 6mo agoEfficiency gains have been so intense that old hardware is still viable for serving brand new mid size models.
- throwaway85825 6mo agoLikely legacy products are running on the old chips because the newer generations are capacity constrained.
- dopa42365 6mo agoHetzner is still running and selling Haswell Xeons and GTX-1080s that are 10+ years old. Definitely not silicon waste the second something faster arrives. There's still a world beyond cutting edge LLM slop after all.
- moogly 6mo agoAnd how many of them were diverted from Tesla?
- electriclove 6mo agoPretty sure that Tesla didn't use Colossus. Tesla used Cortex 1 and Cortex 2 which are at the Gigafactory in Austin.
- moogly 6mo agoTesla famously never got to use them https://arstechnica.com/cars/2024/06/elon-musk-is-diverting-teslas-gpus-to-x-xai-nvidia-emails-say/ https://arstechnica.com/cars/2024/06/elon-musk-is-diverting-...
- electriclove 6mo agoThe article says: In December, an internal Nvidia memo seen by CNBC said, “Elon prioritizing X H100 GPU cluster deployment at X versus Tesla by redirecting 12k of shipped H100 GPUs originally slated for Tesla to X instead. In exchange, original X orders of 12k H100 slated for Jan and June to be redirected to Tesla.”
- TheAlchemist 6mo agoWhat would be interesting to know how much did it cost xAI to build it ? Ai says between $18-$40 billion to just build, without running cost, but no idea how close to reality this is.
- pbmango 6mo agoAnthropic is getting capacity from Colossus 1 not Colossus 2 it sounded like. The initial colossus capex was under $5B, making that an even more astounding payoff. Edit: S1 states both are being leased so the 20-25B initial investment probably more relevant
- gjsman-1000 6mo ago... and a sign Anthropic couldn't find enough compute anywhere else, so they had to bite the bullet. Interesting.
- TheAlchemist 6mo agoThe S-1 states that it gets capacity from both Colossus 1 and Colossus 2.
- btian 6mo agoCloser to 18b than 40. Running costs are 1-2b a year.
- tristanj 6mo agoMore like $25 billion since 2025, with $7 billion of spending in the past 3 months. Look at page 22 of the filing.
- jsnell 6mo agoThe AI row of the capex table in the S-1 should be a pretty close approximation.
- pianoben 6mo agoNobody pays MSRP at that scale