3 ms·
For fast Kimi K3? You're damn right I do
by anigbrowl 3mo ago
For fast Kimi K3? You're damn right I do
- wmf 3mo ago$1,000 only gets you the Qwen 27B cartridge. For Kimi K3 it would be more like $100,000 (and the "cartridge" is the size of a refrigerator).
- trollbridge 3mo agoI would gladly pay $100,000 for local K3 running at 18,000 tok/sec.
- anigbrowl 3mo agoSome hurried goalpost-moving there! If we take Qwen 27B as the benchmark of equivalent power (rather than its default configuration with no fine-tuning), I can still think of applications. Auto summarization for legal document databases and other high security/offline contexts, contraband detection, moderating websites like HN etc :)