3 ms·
That's not even a server, that's a GPU. There's often 2-4 H100 cards per 1U of server, so a 4U server could have 8 of those. This whole satellite hosts somethin
by yencabulator 11mo ago
That's not even a server, that's a GPU. There's often 2-4 H100 cards per 1U of server, so a 4U server could have 8 of those. This whole satellite hosts something like 1/168th of a rack of compute, and the GPU only causes only about 100W of heat.