3 ms·
Agreed it's annoying, but on a certain level also not entirely wrong. In a software 2.0 [0] world the weights are functionally the code in that it is what gets
by Havoc 3y ago
Agreed it's annoying, but on a certain level also not entirely wrong. In a software 2.0 [0] world the weights are functionally the code in that it is what gets you from input to output.
Open weights or something similar would be better though
[0] https://karpathy.medium.com/software-2-0-a64152b37c35 https://karpathy.medium.com/software-2-0-a64152b37c35
- charcircuit 3y agoWeights are configuration.
- alanbernstein 3y agoWeights almost entirely encapsulate the behavior of the model. Whatever structural analogy you want to use, they are closest in spirit to the core functional algorithm of traditional software.
- dns_snek 3y agoAre symbols in your source file merely a configuration file for the compiler/interpreter?
- charcircuit 3y agoNo, but I would consider the command line flags to be configuration.