3 ms·
They could never economically achieve the required volume of training data from licensed data alone. The model requires plagiarizing the Internet.
by pjc50 2y ago
They could never economically achieve the required volume of training data from licensed data alone. The model requires plagiarizing the Internet.
- Sakos 2y agoThere are two conditions for AI working at all. 1) Access to all the internet's data without restriction, including all books and research papers. 2) The model isn't controlled and owned by a for-profit company, it has to be an intra-country initiative run for the benefit of mankind. Anything else is a wild misuse and bastardisation of AI. We're already seeing all the issues inherent in our current approaches.
- exitb 2y agoWhat if they do a "clean room approach" of sorts. One non-public LLM is trained on copyrighted material and creates its own articles about stuff. Then a public LLM is trained on these articles. It appears to work for people-based processes.
- techjamie 2y agoThe problem with that approach is that any biases the original model has will be amplified during the training process, and cause it to have issues.
- tivert 2y ago> It appears to work for people-based processes. Machines aren't people, and workarounds based on the affordances given to people should not work for machines, because machines should not be given those affordances.
- ben_w 2y agoI see no reason to care what affordances someone gives to an (artificial) machine that I don't own.