12 ms·

the total cost spent on tokens may go up, but i just cant imagine per token costs going up

• jrflo 1mo ago
  Depends on compute capacity. If we become supply constrained on tokens, then prices will necessarily go up.
  • anthonypasq 1mo ago
    no they dont because inference stacks are getting more efficient and models are getting more intelligent per parameter.
    • vlovich123 1mo ago
      I would posit there’s no way in hell they’re getting sufficiently cheaper on a short enough time frame vs how much demand is sky rocketing. AI companies are seeing quarterly doubling of revenue if not more.