6 ms·
> serving models is very profitable (70%+) All your argument hangs on this. I see no evidence of this being true.
by surgical_fire 26d ago
> serving models is very profitable (70%+)
All your argument hangs on this.
I see no evidence of this being true.
- vanuatu 26d agohttps://www.seangoedecke.com/ai-inference-is-obviously-profitable/ https://www.seangoedecke.com/ai-inference-is-obviously-profi... https://www.mindstudio.ai/blog/anthropic-inference-margins-70-percent-api-costs https://www.mindstudio.ai/blog/anthropic-inference-margins-7... its even higher depending on the model, how optimized it is, and the chips! I wouldnt die on this hill
- surgical_fire 25d agoThis is not evidence. This is random people speculating on Anthropic's margins without any real evidence. Just because it is on some blog post, it does not make it true. I wasted the time to read the first blog post. It considers 100% utilization over the course of years to calculate an estimation, and it did not consider depreciation for the model itself. That thing is extremely extensive to create, and after a relatively short amount of time is considered outdated.
- aurareturn 25d agoHow much work did you go into looking for evidence?