3 ms·
All you need is a 4x 4090 GPUs and a dedicated 30 amp circuit.
by bb88 2y ago
All you need is a 4x 4090 GPUs and a dedicated 30 amp circuit.
- fzzzy 2y agoYou sure? In my experiments with multi gpu inference, I couldn't get anywhere close to max theoretical power draw.
- sabareesh 2y agoWell during training all GPUs were consuming max ~ 450W
- fzzzy 2y agoThanks, good to know. Perhaps it is different for diffusion; with llms, layers are generally split across gpus, meaning inference has to happen on one gpu before the values can be passed between the layer split.
- bb88 2y agoYes! His power supplies are 2x1500 Watt. That puts it at 3KW max which is more than a 20A circuit can provide (2400W). The standard outlet is typically rated at 15 amps or 1800W. And the 15A breaker is on one circuit. You can get 20A circuits but they need to be wired for it, and replacing the breaker won't cut it. Assuming his GPU is ~450W (his number) and power supplies are 80% efficient, well that means he's pulling close to ~2400 watts which is super close to the limit of a 20A circuit. 4 * 450 / 0.80 efficiency = 2250W. That doesn't include the power consumed by the CPU or mother board or other things on that circuit. But a 170W CPU would easily push this over 2400W provided by a 20A circuit.
- deleted 2y ago[deleted]
- andrewmcwatters 2y agoWhy are people downvoting this? Yes, you really do need a dedicated circuit to run this type of machine. You will trip your circuit breaker if you don't have sufficient wattage on the line to run something rated for this power draw. Commercial setups are not appropriate for typical 15 amp circuit loads.
- andrewmcwatters 2y agoFurther, If you can afford to build this, you can afford to purchase at least the Romex, an AFCI circuit breaker, raceway, and run it into whatever room in the house you plan on operating this in.