4 ms·
> do the electricity math Could you give an example with real figures?
by JumpCrisscross 4mo ago
> do the electricity math
Could you give an example with real figures?
- nok22kon 4mo agoobviously depends on your location and GPU for me it would be about $2 per day in electricity to generate 8 mil tok of Gemma4-26B at 4 bit quantization. this is excluding how much the GPU cost (no amortization) ignoring the fact that I could get more free tokens per day for this model from Google/OpenRouter, it would cost $4 per day on OpenRouter if paid, but they would run it at full 16 bit precission this would be the most "profitable" model for me for Gemma4-31B I can generate only 1 mil tok per day, and so I pay more to get less quality than OpenRouter (ignoring that this model is also free on Google)
- s1artibartfast 4mo agoThis is very interesting to me. How do you come up with the kwh/token for your setup?
- nok22kon 4mo agoI know how many tokens per second my computer generates, and I have a wall power meter which measures how many watts my computer is using when generating.