3 ms·
Interesting, if you take a look at the median throughput chart [0], groq goes insane after 7th Oct. Wonder what happened. [0] https://openrouter.ai/moonshotai
by meander_water 1y ago
Interesting, if you take a look at the median throughput chart [0], groq goes insane after 7th Oct. Wonder what happened.
[0] https://openrouter.ai/moonshotai/kimi-k2-0905/performance https://openrouter.ai/moonshotai/kimi-k2-0905/performance
- awestroke 1y agoHeavy quantization
- petesergeant 1y agoThey claim (or someone on Reddit who claims to be staff claims) that's not accurate: https://www.reddit.com/r/LocalLLaMA/comments/1mk4kt0/comment/n8idqet/ https://www.reddit.com/r/LocalLLaMA/comments/1mk4kt0/comment...
- sigmar 1y ago2x jump overnight. new LPU hardware? I checked the speed for groq's gpt-oss-120B, Llama4-maverick, and Llama4-scout; none of them had a noticeable change this month