3 ms·
Can't find where the A100 figure comes from, but an RTX 4090 can generate more than an image a second[0], which assuming constant power usage of 450W would be 0
by Ukv 2y ago
Can't find where the A100 figure comes from, but an RTX 4090 can generate more than an image a second[0], which assuming constant power usage of 450W would be 0.000125kWh - compared to, say, 2.4kWh for a pot of coffee[1].
If you're running it as a service, you'd likely optimize the model with TensorRT and run on hardware intended for inference, instead of consumer/training GPUs, so I don't think either of these figures can be extrapolated to Midjourney.
[0]: https://cdn.mos.cms.futurecdn.net/RtAnnCQxaVJNYgA4LbBhuJ-970-80.png https://cdn.mos.cms.futurecdn.net/RtAnnCQxaVJNYgA4LbBhuJ-970...
[1]: https://electricityplans.com/how-much-electricity-does-a-coffee-maker-use/ https://electricityplans.com/how-much-electricity-does-a-cof...