3 ms·
And so I'm skeptical of TFA's claim that "creativity _isn't [just]_ compression" Imho there's also a clean argument against the existence of LLM-understanding:
by oliculipolicula 3mo ago
And so I'm skeptical of TFA's claim that "creativity _isn't [just]_ compression"
Imho there's also a clean argument against the existence of LLM-understanding: chatbots have been unable to summarize to experts (see my reply to you in the other thread) their own findings.
Even after prolonged interrogation. They were unable to _compress_ their own findings. Thus they might not actually understand what they have actually done. (They might barely pass an oral thesis defense)
(One may object-- that proofs aren't data that can be "compressed". But then doesn't the process of abduction generalise the very idea of data? to.. ?)
- eru 3mo agoI'm not sure, many chat bots summarise just fine as far as I can tell, on subjects I know a lot about.
- oliculipolicula 3mo agoI observe this too. It's just on the breakthroughs chatbots independently achieved , ie stuff not in the training data..? Note that there are some differences between the different breakthroughs. The ones that humans were close to solving already were better explained imho