3 ms·
It’s not bad kind of expensive for 25c but if the prompt is rendered cost is much better.
by nothercastle 3mo ago
It’s not bad kind of expensive for 25c but if the prompt is rendered cost is much better.
- criddell 3mo agoI wonder what the non-subsidized cost is. Add in the electricity and water too. We may be boiling the oceans but at least we are finally getting some good SVGs of pelicans on bicycles.
- dannyw 3mo agoWe're looking at a MoE with 50B active params, each inference pass only requires the compute of a 50B dense model.