5 ms·
Yes, my understanding is: - finding patterns in data is memorization - finding patterns in metadata is intelligence - finding patterns in meta-metadata is in
by QueensGambit 1y ago
Yes, my understanding is:
- finding patterns in data is memorization
- finding patterns in metadata is intelligence
- finding patterns in meta-metadata is invention
For example, if you ask someone to hang a painting in an art gallery 12 feet from the floor using a 13-foot ladder:
- a worker will use the safety rule of staying 5 feet away from the wall. This is what GPT-3 does. [1]
- an engineer will apply the Pythagorean theorem. This is what o3 does.
- Pythagoras, seeing it for the first time, will derive the theorem. GPT-5 is nowhere close to that.
This climbing up the ladder of abstraction existed even before LLMs. DeepMind's AlphaGo learned from human games. But AlphaGo Zero and AlphaZero trained entirely through self-play and began uncovering new strategies across Go, chess, and shogi. So whether it's code, a game, or pseudocode, they're all metadata operating at the same level of abstraction.
[1] The Nature of Intelligence is Meta - https://manidoraisamy.com/intelligence-is-meta.html https://manidoraisamy.com/intelligence-is-meta.html