3 ms·
obviously depends on your location and GPU for me it would be about $2 per day in electricity to generate 8 mil tok of Gemma4-26B at 4 bit quantization. this i
by nok22kon 4mo ago
obviously depends on your location and GPU
for me it would be about $2 per day in electricity to generate 8 mil tok of Gemma4-26B at 4 bit quantization. this is excluding how much the GPU cost (no amortization)
ignoring the fact that I could get more free tokens per day for this model from Google/OpenRouter, it would cost $4 per day on OpenRouter if paid, but they would run it at full 16 bit precission
this would be the most "profitable" model for me
for Gemma4-31B I can generate only 1 mil tok per day, and so I pay more to get less quality than OpenRouter (ignoring that this model is also free on Google)
- s1artibartfast 4mo agoThis is very interesting to me. How do you come up with the kwh/token for your setup?
- nok22kon 4mo agoI know how many tokens per second my computer generates, and I have a wall power meter which measures how many watts my computer is using when generating.