3 ms·

The models are good enough now, so I'm waiting for the day they start selling inference ASICs with 100x the token output speed. See Taalas demo.

• adityamwagh 6mo ago
  Taalas is a nice concept, but I don’t want to use the same model forever!
  • amelius 6mo ago
    Just buy a new one every few years, just like your phone and laptop. And sell the old one.
    • lostmsu 6mo ago
      At the current rate of changes the old one will sell for almost 0.