3 ms·
> how do you explain [...] Certain outputs demonstrating meta-coherence that wasn’t explicitly in the training data. Some sequences forming self-referential rea
by bigyabai 2y ago
> how do you explain [...] Certain outputs demonstrating meta-coherence that wasn’t explicitly in the training data. Some sequences forming self-referential reasoning loops that are not just interpolations of known patterns.
Okay, a few things, then:
1. I don't want to condescend! There are super straightforward answers to these questions and I want to help lead you to understanding them. Please ask if you want me to cite any code for you to examine.
2. Text is an imperfect metric for measuring cognition or even coherency. See the Chomsky refutations, Hubert Dreyfus' research, or Library of Babel for some pre-LLM thought experiments on this matter.
3. You haven't shown your own statistical examples of extraordinary LLM performance so I can't quantitatively refute you. My analysis is that LLM capabilities are roughly on-par with both mathematical expectations and modern scaling laws.