3 ms·
There's probably less margin on the low end, so they don't want to focus on capturing it.
by odie5533 1y ago
There's probably less margin on the low end, so they don't want to focus on capturing it.
- dr_dshiv 1y agoMargin? Hahahahaha
- odie5533 1y agoInference is profitable.
- reppap 1y agoIf you completely ignore inference revenue needing to offset training costs. Is inference still profitable if you account for the amortized training cost?
- yunwal 1y ago> If you completely ignore inference revenue needing to offset training costs. This is what people mean when they say margin. When you buy a pair of shoes, the margin is price/(materials+labor), and doesn’t include the price of the factory or the store they were bought in
- simonw 1y agoNot for the big labs, who are engaged in an astonishingly competitive buildout right now. There are a bunch of companies who offer inference against open weight models trained by other people. They get to skip the training costs.
- bobxmax 1y ago[dead]