3 ms·
There are rumors that the K2 model Groq is serving is quantized or otherwise produces lower-quality responses than expected due to some optimization, FYI. I te
by meowface 1y ago
There are rumors that the K2 model Groq is serving is quantized or otherwise produces lower-quality responses than expected due to some optimization, FYI.
I tested it and the speed is incredible, though.
- skeezyboy 1y agohave they managed to remove the "output may contain mistakes" disclaimer from a single LLM yet?
- lazide 1y agoNever will. But then, same for humans yes?
- skeezyboy 1y ago>But then, same for humans yes? And? Whats your point? This is a computer. Humans make errors doing arithmetic, therefore should we not expect computers to be able to reliably perform arithmetic? No. Silly retort and a common reply from people who are suitably wowed by the current generation of AI.