33 ms·
How can something so obvious be overlooked by team building the data centre? Can't the sharding be uneven so that weaker GPUs still finish fast by taking on a s
by renticulous 4mo ago
How can something so obvious be overlooked by team building the data centre? Can't the sharding be uneven so that weaker GPUs still finish fast by taking on a smaller workload?
- Maken 4mo agoIt's not like they had much of an option, when everybody was hoarding every GPU they could. For the second Colossus they could book future production, but the first one had to be built ASAP so xAI looked as a serious competitor in the AI space.
- sjsdaiuasgdia 4mo agoI imagine it involved a petulant billionaire screaming "Fucking build it. Build it NOW!" in response to expert feedback.