4 ms·
That’s not how it works though. Two training runs on the same data don’t produce the same weights. And if you want to modify the AI, you do so by fine tuning th
by adastra22 2mo ago
That’s not how it works though. Two training runs on the same data don’t produce the same weights. And if you want to modify the AI, you do so by fine tuning the weights not rerunning training. In every respect that matters, the weights are both the binary and the source code together.
- stavros 2mo agoIf I want to remove censorship from your open-weights model, how do I do that?
- Tryk 2mo agoThe process is called Ablation, there are many ablated models available to download https://en.wikipedia.org/wiki/Ablation_(artificial_intelligence) https://en.wikipedia.org/wiki/Ablation_(artificial_intellige...
- overfeed 2mo ago> ...how do I do that? Put in the work. This is akin to asking how to remove Rust from a Rust project; just because something is legally available to you doesn't mean you wont need to apply dome elbow grease, depending how deep the changes you want are, ablation, fine-tuning, or distillation are tools you can use to remove "censorship"
- raincole 2mo agoBy this standard there is no closed source software on PC. You can always modify the binary directly or hook your functions in.
- riversflow 2mo agoWouldn’t any software that is a client and relies on a proprietary server to function (like most modern AAA games) be “closed source” under this definition? Not that I agree with this definition of open source btw, just saying that there is precedent.
- spider-mario 2mo agoTwo builds of the same source code don’t always produce exactly the same binary either, but we don’t use that as an excuse to distribute object files and call it open-source.
- xdertz 2mo agoThis is the same as saying every binary is open source because you can look at and change the machine code. Open source means you reveal how you created this binary.
- adastra22 2mo agoBut training is not deterministic. The same training run on the same input can result in very different models. And even if you ignore the intrinsically stochastic part of training, the effort of creating a model is ad-hoc and involving humans. It is a crafted output, not a compiler output. The pre-training is the closest to being mechanistic, but these models are so many layers of work on top of the pretraining, and those higher layers have people in the loop. They run experiments, tweak things, run experiments again.