3 ms·
If revenue doesn't catch up with the cost of developing and running these huge LLMs then the only way to avoid an AI winter is to find a way to make them way ch
by 369548684892826 1y ago
If revenue doesn't catch up with the cost of developing and running these huge LLMs then the only way to avoid an AI winter is to find a way to make them way cheaper to develop.
- infecto 1y agoInference costs are largely break even and profitable. Now yes there is absolutely questions on the training side. You could turn off the switch today though and most of your leading models could keep the lights on.
- algorithmmonkey 1y agoI keep seeing everyone guessing what the margin is on inference. You say that it's largely break even. We have this person in the thread claim 80% margin (https://news.ycombinator.com/item?id=45462442 https://news.ycombinator.com/item?id=45462442). These numbers are complete make believe.
- infecto 1y agoWhy would they be make believe? I am generalizing across multiple companies and simplifying it as much as possible as we won’t know all the cost buckets but we do know at current costs the bare inference cost of keeping the machines running is being covered.