4 ms·
> What is the equivalent of the training data for something like the Linux kernel? It's the source code. For the linux kernel: compile(sourcecode)
by enriquto 2y ago
> What is the equivalent of the training data for something like the Linux kernel?
It's the source code.
For the linux kernel:
compile(sourcecode) = binary
For llama:
train(data) = weights
- jdminhbg 2y agoThat analogy doesn't work. `train` is not a deterministic process. Meta has all of the training data and all of the supporting source code and they still won't get the same `weights` if they re-run the process. The weights are the result of the development process, like the source code of a program is the result of a development process.