4 ms·
> It's only open source if you can generate the binary weights from the training data and the training algorithm and training (hyper) parameters, from scratch.
by menzoic 3y ago
> It's only open source if you can generate the binary weights from the training data and the training algorithm and training (hyper) parameters, from scratch. Releasing only the binary weights, does not make it open source, just like releasing only binary executables has nothing to do with open source.
The weights aren’t binary. It’s not a compile form, it’s the actual source of the AI model.
The same code used to train the model / generate the weights will not produce the same model weights if run again, it is not deterministic.
Also you will need millions of dollars to retrain, retraining is not the goal. The model weights are the source that was opened. The weights can be used to modify the model.
- amelius 3y ago> The weights aren’t binary. The weights are typically distributed as a binary blob containing IEEE floating point values, or fixed point values; and these numbers are typically not meant for direct human consumption. > The same code used to train the model / generate the weights will not produce the same model weights if run again, it is not deterministic. This is not true, except in contrived situations like when you use PRNGs and you deliberately throw away their seeds. > Also you will need millions of dollars to retrain This is besides the point.