3 ms·
LLMs fundamentally work by predicting the next word (token). But that should not be used to diminish their potential capabilities. It's like saying that human b
by Marha01 4mo ago
LLMs fundamentally work by predicting the next word (token). But that should not be used to diminish their potential capabilities. It's like saying that human brains "just predict (or produce) the next electrical impulse". Fundamentally correct, but says nothing about the potential emergent capabilities of scaled-up systems that work like that.
Emergent properties of complex systems should not be diminished just because the underlying operating principle is simple.
- layla5alive 4mo agoSo much this - so many people seem to miss the forest from the trees that emergent properties are not bound to the complexity of the underlying mechanics. All of life arises (maybe) from very simple subatomic particles, and at each stage you can repeat this refrain, complexity increasing as you stack.
- galaxyLogic 4mo agoGame of Life comes to mind: Most simple logic, emerging patterns are hard to believe.
- podocarp 4mo agoTrue, but there are also some who push it too far. As with all things, take it with moderation.