4 ms·

Margin? Hahahahaha

• odie5533 1y ago
  Inference is profitable.
  • reppap 1y ago
    If you completely ignore inference revenue needing to offset training costs. Is inference still profitable if you account for the amortized training cost?
    • yunwal 1y ago
      > If you completely ignore inference revenue needing to offset training costs. This is what people mean when they say margin. When you buy a pair of shoes, the margin is price/(materials+labor), and doesn’t include the price of the factory or the store they were bought in
    • simonw 1y ago
      Not for the big labs, who are engaged in an astonishingly competitive buildout right now. There are a bunch of companies who offer inference against open weight models trained by other people. They get to skip the training costs.
• bobxmax 1y ago
  [dead]