3 ms·
I've long thought of the GPU servers with 6x or whatever top tier GPUs & cackle a bit that a regular 15A circuit in a house wouldnt have enough power, that it's
by rektide 4y ago
I've long thought of the GPU servers with 6x or whatever top tier GPUs & cackle a bit that a regular 15A circuit in a house wouldnt have enough power, that it's creating considerably more heat than a plug in space heater.
It's great to see massively multicore really ramping up in CPU land. Watts burned to push MHz way up are usually ill spent, but spending watts to scale out, to power huge caches, can often be quite efficient. We're just doing more work. By compare, buying a ton of amaller blades feels like there's much more redundant parts purchases, with lots of motherboards lots of sleds lots od nics, and those blades have nowhere near the core fabric you get from massive multicore. Putting more computing closer together decreases latency among the systems & decreases joules/bit, & we're making incredible gains getting more together.
I dont think it'll have a massive total system impact, but also notable that transcievers are also >10W, and SSD's probably near there as well, especially with bigger & faster CXL designs we'll be seeing more & more of.
It seems like watercooling is upcoming king, but theres a lot of componemts that still need some cooling & unless you go immersion that still has a big parts & budget cost. I feel like we could or should be using convection more, maybe turning servers off the horizontal & making them verticle, but that's obviously way harder to install & handle.