3 ms·
> healthy profit margin (as near as we can tell from the outside) Ugh we still don't know if this is true and it's nearly impossible to calculate without a ful
by mbesto 22d ago
> healthy profit margin (as near as we can tell from the outside)
Ugh we still don't know if this is true and it's nearly impossible to calculate without a full understanding of the real CAPEX cycle. Stop spreading these rumors until we know for sure.
- bryanlarsen 22d agoSemiAnalysis estimates their profit margin to be 70%. To be losing money on inference implies that their costs are almost 4X higher than SemiAnalysis has calculated. That's not credible.
- p-e-w 22d agoI don’t see how they could credibly estimate inference costs without knowing the model size.
- FuckButtons 22d agoBut we do have a reasonable estimate of model size.
- nbardy 21d agoYou can estimate the model size by looking at tokens per second and comparing to open source models