3 ms·
Kind of hilarious that the vast capabilities of an LLM are held back by copyright infringement.
by giancarlostoro 3y ago
Kind of hilarious that the vast capabilities of an LLM are held back by copyright infringement.
- joquarky 3y agoThe original purpose of copyright was to promote progress, and now it seems to hinder it.
- TeMPOraL 3y agoIntellectual property rights will yet turn out to be one of the Great Filters.
- zozbot234 3y agoI'd love to see a language model that was only trained on public domain and openly available content. It would probably be way too little data to give it ChatGPT-like generality, but even a GPT-2 scale model would be interesting.
- TeMPOraL 3y agoIf, hypothetically, libraries in the US - including in particular the Library of Congress - were to scan and OCR every book, newspaper and magazine they have with copyright protection already expired, would that be enough? Is there some estimate for the size of such dataset?
- Turing_Machine 3y agoMuch of that material is already available at https://archive.org https://archive.org. It might be good enough for some purposes, but limiting it to stuff before 1928 (in the United Sates) isn't going to be very helpful for (e.g.) coding. Maybe if you added github projects with permissive licenses?