3 ms·
I don’t understand your calculation, can you elaborate? At 25USD/Mtk output, assuming your 20tk/s, I generated/saved (minus power costs) ~15k$ in a year. Grant
by illiac786 4mo ago
I don’t understand your calculation, can you elaborate? At 25USD/Mtk output, assuming your 20tk/s, I generated/saved (minus power costs) ~15k$ in a year.
Granted, it won’t run 24/7, but over a couple of years, this is definitely cheaper.
- chis 4mo agoThis can’t run any models that cost $25/mtok lol. I think the fastest model it’ll reasonably run will be GPT-OSS 120B which costs $.05/mtok. This is a laptop for CUDA devs and AI larpers.