3 ms·

I remember someone mentioned on other thread that after distilled, llama will have no license issue. can someone explain why is that the case? Probably can giv

• MacsHeadroom 3y ago
  Because machine leaning models likely have zero intellectual property rights protections. LLMs are the output of an "algorithmic process". Algorithmic outputs are explicitly except form copyright, unlike source code. (Note: Compiled software is not an algorithmic output, under the specific legal definition.) Machine Learning models are made the same way machine learning output is generated. In other words, the old model is training data to the new model. Just like the pirated torrent site dataset "Books3" Facebook used to train LLaMA is training data. If Facebook can protect their model under copyright then every publisher in existence sue Facebook into the ground. They can't have it both ways.
  • nextaccountic 3y ago
    > In other words, the old model is training data to the new model. Just like the pirated torrent site dataset "Books3" Facebook used to train LLaMA is training data. This is a logical conclusion. But if it actually holds, that's for the courts to decide