4 ms·
You could fine tune and release that. It’s not software so exact parallels don’t make sense, but the open permissions are great.
by scosman 3y ago
You could fine tune and release that. It’s not software so exact parallels don’t make sense, but the open permissions are great.
- monocasa 3y agoI mean, it's absolutely software.
- scosman 3y agoSoftware is used to make models, but the models aren’t software anymore than Toy Story is software.
- monocasa 3y agoThere's literally a list of opcodes to be executed in the model. There's a whole lot of data too, but that's part of the build just as much as anything in a .data section.
- mbakke 3y agoForgive my ignorance, I haven't studied the AI tooling landscape yet. Are you saying these models have a structured binary format and "running" them is just a matter of having a "player" with the right "codec"? Or are they directly executing CPU instructions?
- monocasa 3y agoThey are basically a series of intermediate bytecodes to be compiled to the hardware they actually run on, in addition to the large tables of weights that bytecode references.
- scosman 3y agoJust a few billion of them that no person created or understands, which are based on the their input data and not design decisions, which include random initialization. I see no reason to treat them any differently than software in a conversation about OSS.
- kanwisher 3y agoModel inputs are definitely design decisions, what data to use, how to fine tune them, what methods were used in weighting things. This is LITERALLY the source of the model. The model is a binary like an EXE
- camgunz 3y agoToy Story is also software. It's a program you run on a renderer to generate a/v.