4 ms·
That's roughly 11.66$ per hour per GPU, which is above the price that Google Cloud is reselling them at if you commit for 36 months: https://getdeploying.com/gp
by hijodelsol 4mo ago
That's roughly 11.66$ per hour per GPU, which is above the price that Google Cloud is reselling them at if you commit for 36 months: https://getdeploying.com/gpus/nvidia-b200 https://getdeploying.com/gpus/nvidia-b200
- redox99 4mo agoThat's for standalone servers. xAI has something that nobody else has. The single largest interconnected cluster[1]. For inference it doesn't really matter, but for training that networking is crucial. [1] Probably, there could be undisclosed clusters owned by other companies.
- hijodelsol 4mo agoI would think that for training Google has optimized their entire setup for TPUs so I can’t see how this would be used for anything but inference
- redox99 4mo agoThat's a good point. That makes it less likely that it's training, but who knows.