3 ms·

Open weight, not open source. There is no way to reproduce the model.

• busssard 3mo ago
  you dont need to reproduce it, if you can finetune it. The alignment in these models is really narrow, it doesnt take many finetuning steps to get out of the alignment basin. the alignment is not data centric but done after the fact using RL...
  • throwaway27448 3mo ago
    You can also modify binaries. This doesn't address the benefits of reproduction more than a smidgeon. How can you answer "why the fuck does it work like this" if you can't inspect the process that built it? There's no replacement for "what was this built from?" Of course, corporate/national investments need some moat, so I don't expect open source models to be competitive for a few years
  • inigyou 3mo ago
    Yeah, but don't call it open source if it's not.
  • chasd00 3mo ago
    You can write mods for Minecraft too but that doesn’t make Minecraft open source.