4 ms·
If you think going to school to get an education is the same thing as training an LLM then you are just so misguided. Normal people read books to gain an unders
by dylan604 2y ago
If you think going to school to get an education is the same thing as training an LLM then you are just so misguided. Normal people read books to gain an understanding of a concept, but do not retain the text verbatim in memory in perpetuity. This is not what training an LLM does.
- brookst 2y agoSome people memorize verbatim. Most LLM knowledge is not memorized. Easy proof: source material is in one language, and you can query LLMs in tens to a hundred plus. How can it be verbatim in a different language?
- dylan604 2y agoThese "some people" would not fall under the "normal people" that I specifically said. but you go right ahead and keep thinking they are normal so you can make caveats on an internet forum.
- mitthrowaway2 2y agoIf you buy a copy of Harry Potter from the bookstore, does that come with the right to sell machine-translated versions of it for personal profit? If so, how come even fanfiction authors who write every word themselves can't sell their work?
- aspenmayer 2y agoDoujinshi authors sell their work all the time.
- ben_w 2y ago> Normal people read books to gain an understanding of a concept, but do not retain the text verbatim in memory in perpetuity. LLMs wouldn't hallucinate so much if they did that, either.
- bshacklett 2y agoLLMs don’t memorize everything they’re trained on verbatim, either. It’s all vectors behind the scenes, which is relatable to how the human brain works. It’s all just strong or weak connections in the brain. The output is what matters. If what the LLM creates isn’t transformative, or public domain, it’s infringement. The training doesn’t produce a work in itself. Besides that, how much original creative work do you really believe is out there? Pretty much all art (and a lot of science) is based on prior work. There are true breakthroughs, of course, but they’re few and far between.