3 ms·
Is training a "pirate model" something you'd reasonably be able to do at home though, given the compute requirements? The analogous "image generation at home" i
by jsheard 3y ago
Is training a "pirate model" something you'd reasonably be able to do at home though, given the compute requirements? The analogous "image generation at home" is only possible due to a for-profit entity with significant resources choosing to (a) play fast-and-loose with the provenance of their training set and (b) giving away the resulting model for free, if the open source community had to train their models from scratch then as best as I can tell they would still be stuck in the dark ages generating vague goopy abominations.
- throwuwu 3y agoYou could take a model trained on CC content and then fine tune it on copyrighted material cheaply and quickly
- PaulDavisThe1st 3y agoCurrently, yes, available compute power @ home does indeed seem like a limitation. Whether that remains true going forward seems a little unclear to me.