3 ms·
You need 64 H200 super-node for inference for kimi k3. You will not do inference locally. What might pop the western hardware bubble is Chinese GPU, memory, net
by russli1993 3mo ago
You need 64 H200 super-node for inference for kimi k3. You will not do inference locally. What might pop the western hardware bubble is Chinese GPU, memory, networking companies. But even in China, these AI centric hardware is not cheap.
- overfeed 3mo ago> But even in China, these AI centric hardware is not cheap Definitely not cheap for individuals, but well within SME territory. There are countless small-town, family-owned businesses that had higher startup costs than a hypothetical Kimi-R-Us, Inc.