4 ms·
It's only got around 5 billion active parameters; it'd be a miracle if it was competitive at coding with SOTA models that have significantly more.
by logicchains 1y ago
It's only got around 5 billion active parameters; it'd be a miracle if it was competitive at coding with SOTA models that have significantly more.
- jph00 1y agoOn this bench it underperforms vs glm-4.5-air, which is an MoE with fewer total params but more active params.