2 ms·
> A neural net designed to do nothing other than compress and decompress a copyrighted work is completely different than GPT-4, unless I'm uninformed. Compress
by mlyle 3y ago
> A neural net designed to do nothing other than compress and decompress a copyrighted work is completely different than GPT-4, unless I'm uninformed.
Compression and the output from LLMs are cousins. The model tries to predict what continuations are likely, given context. Indeed, it takes a lot of effort to make LLMs less willing to just output training data verbatim. And conversely, you can get compression algorithms to do things similar to what LLMs do (poorly).
Whether this also describes most of human cognitive process, is subject to debate.