3 ms·

I run KimiK2 at home, Most of it on system ram with a few layers offloaded to old 3090s. This is a cheap budget build. Kimi-K2-Thinking-UD-Q3_K_XL-00001-of

I run KimiK2 at home, Most of it on system ram with a few layers offloaded to old 3090s. This is a cheap budget build. Kimi-K2-Thinking-UD-Q3_K_XL-00001-of-00010.gguf Generation - 5,231 tokens 604.63s 8.65 tokens/s

mapkkk 9mo ago
Could I trouble you for the specifics of your build? I'd love to see if it would be a viable upgrade for me. I currently have a 3970x with a bunch of 3090s.
- segmondy 9mo ago
  4 3090s, epyc MB with 8 channel memory, 7352 cpu, slow 2400mhz ddr4 rams.