4 ms·
One trivial reason might be the size of the artefacts / hardware requirements? Kimi K3 is ≈ 1.5 TB and requires multi million dollar hardware to run. Compared t
by filleokus 15d ago
One trivial reason might be the size of the artefacts / hardware requirements? Kimi K3 is ≈ 1.5 TB and requires multi million dollar hardware to run. Compared to e.g game development, I'm guessing that it's not like a bunch of people at Anthropic/OpenAI have the models running "locally".
It's easier to protect a power substation from being stolen then a Rolex watch
- Melatonic 15d agoOr the ones doing the stealing are so competent (or embedded) we don't hear about it
- PunchyHamster 15d agoThat's "only" 11h of download at 300Mbit/s
- doublerabbit 14d agoHow long would it be on 56k? I recall having to reconnect to my ISP every three hours to resume downloading an iso back in those days.
- larodi 14d agoWell this concludes then that it’s like a handful of actual engineers and ML ppl that have access to it and have taken all precautions to keep it locked. Again - many people have so far left these companies and none brought an usb drive out with what very likely does not constitute copyrightable materials in the first place.
- ux266478 14d ago> Kimi K3 is ≈ 1.5 TB and requires multi million dollar hardware to run. Not that it defeats your point, but an 8x MI355X node is $350k-400k. The only reason you're paying that much is for the VRAM, too. You could run it with much less compute than what you get in a single card.