4 ms·

Yeah but as one of the replies points out the resulting tokens/second would be unusable in production environments

• vanillax 2y ago
  What? Literally use it at work to write code.
  • jt_b 2y ago
    I think they're talking about using it to power inference for self hosted user facing applications.
    • vanillax 2y ago
      ahhhhh yes ok. Totally agree here.