3 ms·

K2 is also now available on Groq https://console.groq.com/docs/model/moonshotai/kimi-k2-instruct https://console.groq.com/docs/model/moonshotai/kimi-k2-instr..

K2 is also now available on Groq https://console.groq.com/docs/model/moonshotai/kimi-k2-instruct https://console.groq.com/docs/model/moonshotai/kimi-k2-instr... very fun to see agents using those backends

meowface 1y ago
There are rumors that the K2 model Groq is serving is quantized or otherwise produces lower-quality responses than expected due to some optimization, FYI. I tested it and the speed is incredible, though.
- skeezyboy 1y ago
  have they managed to remove the "output may contain mistakes" disclaimer from a single LLM yet?
  - lazide 1y ago
    Never will. But then, same for humans yes?
    - skeezyboy 1y ago
      >But then, same for humans yes? And? Whats your point? This is a computer. Humans make errors doing arithmetic, therefore should we not expect computers to be able to reliably perform arithmetic? No. Silly retort and a common reply from people who are suitably wowed by the current generation of AI.
      - lazide 1y ago
        This is incredibly dumb.
        skeezyboy 1y ago
        whats what im trying to tell you
jscheel 1y ago
k2 on groq is really bad right now. I'm not sure what's causing the problem, but they've said that they are working on a few different issues.