78 ms·
Okay I will be honest, I was so hyped up about This model but then I went to localllama and saw it that the: 120 B model is worse at coding compared to qwen 3
by Imustaskforhelp 1y ago
Okay I will be honest, I was so hyped up about This model but then I went to localllama and saw it that the:
120 B model is worse at coding compared to qwen 3 coder and glm45 air and even grok 3... (https://www.reddit.com/r/LocalLLaMA/comments/1mig58x/gptoss120b_below_glm45air_and_qwen_3_coder_at/ https://www.reddit.com/r/LocalLLaMA/comments/1mig58x/gptoss1...)
- logicchains 1y agoIt's only got around 5 billion active parameters; it'd be a miracle if it was competitive at coding with SOTA models that have significantly more.
- jph00 1y agoOn this bench it underperforms vs glm-4.5-air, which is an MoE with fewer total params but more active params.
- ascorbic 1y agoThat's SVGBench, which is a useful benchmark but isn't much of a test of general coding
- Imustaskforhelp 1y agoHm alright, I will see how this model actually plays around instead of forming quick opinions.. Thanks.
- pxc 1y agoQwen3 Coder is 4x its size! Grok 3 is over 22x its size! What does the resource usage look like for GLM 4.5 Air? Is that benchmark in FP16? GPT-OSS-120B will be using between 1/4 and 1/2 the VRAM that GLM-4.5 Air does, right? It seems like a good showing to me, even though Qwen3 Coder and GLM 4.5 Air might be preferable for some use cases.