3 ms·
DeepSeek-v4.1 Flash: Pushing the Limits of KV Cache Compression
- arikrahman 19d agoI am very impressed with the KV Cache Compression work as well as the prefix cacheing making queries converge on practically free.
- smy20011 19d agoRemoved
- vivzkestrel 19d ago404 on the blog page? https://zartbot.github.io/blog/ https://zartbot.github.io/blog/
- sanufar 19d agoYeah, for some reason their /blog/ is 404ing but for anyone interested in their other articles, https://github.com/zartbot/blog/ https://github.com/zartbot/blog/ has all of them, just sub out anything after /blog/.* with the folder path (e.g https://zartbot.github.io/blog/arch/jalapeno/ https://zartbot.github.io/blog/arch/jalapeno/ from https://github.com/zartbot/blog/tree/main/arch/jalapeno https://github.com/zartbot/blog/tree/main/arch/jalapeno)
- N_Lens 19d ago[dead]
- mmastrac 18d agoI've been working with an automatic incremental context compactor enabled and it's been surprisingly helpful. It was particularly effective with DS41f - I think I was running at an effective session length of 5M, with the model running around 300k-400k and it was holding on both speed and intelligence. TBH I also ran the 400tok/s preview and that was just nuts. I just let the thing compact over and over over the course of a day attacking a couple of tough problems
- nchmy 18d agoCan you share a link to thr automatic compactor? I've been noticing that when I get to around 60% context window, the cache will simply break and suddenly I've paid 50x more than expected. The only solution seems to be to compact or start a new session.
- mmastrac 18d agoSend me an email- it's not public just yet