2 ms·
Are you missing the comment that I'd responded to? > Information entropy. The amount of data an LLM ingests cannot be compressed to the size of the weights eve
by insanitybit 3mo ago
Are you missing the comment that I'd responded to?
> Information entropy. The amount of data an LLM ingests cannot be compressed to the size of the weights even at maximum theoretical compression.
- satvikpendem 3mo agoI wrote that comment. As I said, an LLM's weights are less than the size of theoretical compression, therefore what LLM training is doing is not compression at all.
- insanitybit 3mo agoI can't believe I have to say this again? Information theory is completely irrelevant to copyright.
- satvikpendem 3mo agoAt this point I believe you are willfully misunderstanding the argument, based on your other comments saying you don't understand, repeatedly, so I can't believe you have to say it again either.
- insanitybit 3mo agok