3 ms·
> Only problem is that LLMs don’t “learn” from blog posts […] LLMs directly incorporate the learning material into their models The "in-context learning" (rega
by dragonwriter 4y ago
> Only problem is that LLMs don’t “learn” from blog posts […] LLMs directly incorporate the learning material into their models
The "in-context learning" (regardless of how you feel about the use of that term) that they do from material incorporated into their prompts does not involve incorporating it into their model.
> The production might be original, depending on its specific circumstances, but the model and the service itself are without any legal doubt derivative works of the original.
Model code is a work, but not derivative of the training data. There’s considerable legal doubt that the models weights themselves are works of authorship at all, which is a prerequisite for being derivative works, so no matter if you are referring to model code or model weights, the statement that model is “without any legal doubt” a derivative work of the training data is false.
- cornholio 4y agoYou are splitting hairs, there is no doubt that transformers can incorporate and reproduce verbatim training data. Just ask ChatGPT to tell you the lyrics of a famous Madonna song. On that basis alone they are derivative works, regardless of how that data is represented internally.