5 ms·
Can we please stop using terminology related to code for something that's not code?
by littlestymaar 3y ago
Can we please stop using terminology related to code for something that's not code?
- hprotagonist 3y agosometimes it’s hard to see a difference.
- aaur0 3y agoExactly - I wrote something on similar lines here : https://medium.com/@anandandbeyond/rethinking-open-source-for-the-era-of-ai-model-sharing-5b1e770a799d https://medium.com/@anandandbeyond/rethinking-open-source-fo...
- Havoc 3y agoAgreed it's annoying, but on a certain level also not entirely wrong. In a software 2.0 [0] world the weights are functionally the code in that it is what gets you from input to output. Open weights or something similar would be better though [0] https://karpathy.medium.com/software-2-0-a64152b37c35 https://karpathy.medium.com/software-2-0-a64152b37c35
- charcircuit 3y agoWeights are configuration.
- alanbernstein 3y agoWeights almost entirely encapsulate the behavior of the model. Whatever structural analogy you want to use, they are closest in spirit to the core functional algorithm of traditional software.
- dns_snek 3y agoAre symbols in your source file merely a configuration file for the compiler/interpreter?
- charcircuit 3y agoNo, but I would consider the command line flags to be configuration.
- choxi 3y agoThere’s always been fuzziness between data and code, it’s kind of the core concept of Turing machines.
- sashb 3y agoWhat is "code" anyways? https://en.wikipedia.org/wiki/Shannon%27s_source_coding_theorem https://en.wikipedia.org/wiki/Shannon%27s_source_coding_theo...
- raincole 3y agoExcept it's code. Weight decides how the model works so it's code. Code is just you telling the computer to work. var a = b * 3 + 2; You're telling me the * 3 + 2 part isn't code and only var a = b is code?