3 ms·

They're getting increasing demand for tokens at an accelerating pace.

• pixelesque 2mo ago
  Is that the same as storing state in a DB and on a filesystem though? Like, I get there are other features they have, and things like history, but I don't think it's quite the same. Isn't most (not all) of the LLM's resources stateless compute to a large degree? (Not defending MS at all though, I currently can't create a PR on the required branch for my work (won't load the branch list) and their availability is really bad recently).
  • DANmode 2mo ago
    > Is that the same as storing state in a DB and on a filesystem though? Google “RLHF”.
    • adithyassekhar 2mo ago
      Didn’t knew they did that.
      • DANmode 2mo ago
        How else?