3 ms·
Not sure about the using less electricity part. With batching, it’s more efficient to serve multiple users simultaneously.
by jl6 6mo ago
Not sure about the using less electricity part. With batching, it’s more efficient to serve multiple users simultaneously.
- TeMPOraL 6mo agoIndeed. Data centers have so many ways and reasons to be much more energy-efficient than local compute it's not even funny.
- chongli 6mo agoThey do, though I don’t think they max out on energy efficient technology. It’s much easier to cut a deal for cheap electricity with a regional government, much to the chagrin of the locals (who see their power bills go up).