2 ms·
Show me a useful LLM that hasn't been trained on copyrighted data. (I'm hoping it's possible to do that, but I've not seen an example yet.)
by simonw 3y ago
Show me a useful LLM that hasn't been trained on copyrighted data.
(I'm hoping it's possible to do that, but I've not seen an example yet.)
- minimaxir 3y agoTechnically the original BERT was mostly trained on Wikipedia (with some potentially-copyrighted books in BookCorpora)
- simonw 3y agoYeah that's what I was trying to hint at when I said "useful" - I'm looking for a general purpose LLM, GPT-3 level or higher. (BERT was useful but not GPT-3 useful.)
- eli 3y agoWikipedia content is also copyrighted, and it’s unlikely that an LLM reproducing it is compatible with its license terms.