3 ms·
I pretty much always wanted to know the cost of running those models, not training those. That should be order of magnitude less.
by habibur 4y ago
I pretty much always wanted to know the cost of running those models, not training those.
That should be order of magnitude less.
- jackmott42 4y agostable diffusion will generate an image in ~30 seconds on an NVidia 3060, so the cost is on the order of cents per image, power use on the order of 170 watts during the generation, or 0.0014166666667 kwh. @ around 5 cents per kwh
- rileymat2 4y agoYou also have to calculate the life expectancy of the card against 30 seconds of its life as an ongoing cost.
- MagnumOpus 4y agoWhich is also on the order of 0.01c per query (answering 5 million queries in the lifetime of a $500 card).
- smulc 4y agoJust ask ChatGPT what the cost is? ;)
- npongratz 4y agoSure, but just remember that it can't do math, so any mathy answer it gives is just bullshit.