3 ms·
Training data without the training regime is useless. A cake is not open source because they list the ingredients.
by noosphr 2mo ago
Training data without the training regime is useless. A cake is not open source because they list the ingredients.
- JumpCrisscross 2mo agoOpen source captures a practical utility as well as a philosophy. When those two cease to converge, the practical prerogative wins. The correct battle would have been weights + regime. But extremists insisted on data, too, which left Meta as the only other real voice arguing with anything practical. They had open weights. I think eventually open use was negotiated and that closed the case except for the folks still arguing about how to pronounce GIF.
- deleted 2mo ago[deleted]
- glitchc 2mo agoIsn't open source not the ingredients but the recipe?
- Der_Einzige 2mo agoWrong. The data (and compute) matters infinitely more than the training regime/architecture. This is the Bitter lesson. I could rerun Kimi K3 with full transformers instead of the hybrid mamba architecture and it would only get better.