3 ms·
> In any case, if a program was built by training against a dataset, the whole dataset is part of the source code. I'm not sure why I keep seeing this. What is
by jdminhbg 2y ago
> In any case, if a program was built by training against a dataset, the whole dataset is part of the source code.
I'm not sure why I keep seeing this. What is the equivalent of the training data for something like the Linux kernel?
- enriquto 2y ago> What is the equivalent of the training data for something like the Linux kernel? It's the source code. For the linux kernel: compile(sourcecode) = binary For llama: train(data) = weights
- jdminhbg 2y agoThat analogy doesn't work. `train` is not a deterministic process. Meta has all of the training data and all of the supporting source code and they still won't get the same `weights` if they re-run the process. The weights are the result of the development process, like the source code of a program is the result of a development process.