3 ms·
There are definitely some good arguments why it wouldn't be defensible (e.g. the phone book argument), but of course this is all new and remains to be seen. Th
by chatmasta 4y ago
There are definitely some good arguments why it wouldn't be defensible (e.g. the phone book argument), but of course this is all new and remains to be seen.
The other interesting aspect of this is that they're classifying it as unauthorized content distribution. Meta was already distributing the weights, but limited their distribution to "researchers" with approved credentials. It was one of those researchers who leaked the weights originally. So it's not like they were reverse engineered from a binary or exfiltrated out of FB HQ. That might be an important bit of nuance.
- curiousllama 4y agoThe phone book argument is super interesting. I wonder if it would hold, though: Wikipedia suggests it relies on the re-user having a new “selection & arrangement.” Kinda tough to rearrange model weights!
- aftbit 4y agoWhat about by fine-tuning using LoRA? That would introduce new layers and re-arrange the data for additional uses.