3 ms·
Such a well written article, refreshing to read in between all the slop. I've used Mimo extensively in the past few months, can't wait to see what v3 will brin
by ricardobeat 4mo ago
Such a well written article, refreshing to read in between all the slop.
I've used Mimo extensively in the past few months, can't wait to see what v3 will bring.
- trollbridge 4mo agoAre you using UltraSpeed? It's my favourite thing about MiMo.
- ricardobeat 3mo agoI did, it’s amazing. Shame it’s going away and not available permanently.
- zozbot234 3mo agoIt's a very nice summary of KV cache storage requirements for the leading open weights models, but ultimately it still shows the DeepSeek V4 series winning by a huge margin on that front. And DeepSeek actually does quite well on needle-in-haystack context recall benchmark so it seems like the outstanding context compression it has isn't even impacting smarts all that much. Keep in mind that KV cache memory requirements usually has a direct impact on how much you can parallelize inference on both large-scale platforms and lower-end edge compute, so this is a very important metric.