3 ms·
The training process is closely curated, bootstrapped, the bulk data is mixed with whatever manual data you have, and it generally requires tremendous amounts o
by orbital-decay 3y ago
The training process is closely curated, bootstrapped, the bulk data is mixed with whatever manual data you have, and it generally requires tremendous amounts of human input and expertise for the model to be even remotely good. It's definitely not just "feeding the data to the model".
- modeless 3y agoCompiling and checking and selecting and filtering and sorting the phone numbers for a phone book and printing that book and distributing it is not trivial. It involves significant work and even a few creative and editorial decisions, but on balance it's not that creative of a process, and the resulting phone book is not copyrightable. As for mixing in your own data, if the model weights inherit the copyright of the data then every existing large language model is illegal.