4 ms·
They do add up a bit. I'm concerned about a future where we do this for _everything_ because that'll truly be a massive scale unless we get smaller models. If w
by thewataccount 3y ago
They do add up a bit. I'm concerned about a future where we do this for _everything_ because that'll truly be a massive scale unless we get smaller models. If we go off 10M queries a day that's
0.0033KW/H / 24 = 0.0001375/D
0.0001375KW/D * 10M = 1375KW/D or 1.375MW/D
(if I did that right)