4 ms·
We know how ML models work: A machine-learning model finds patterns in the input data, looks at its vast statistical knowledge (lossy-encoded as multi-dimension
by hansword 4y ago
We know how ML models work: A machine-learning model finds patterns in the input data, looks at its vast statistical knowledge (lossy-encoded as multi-dimensional latent space), and then generates patterns which are statistically close to the input data.
If this instance of 'statistically close' corresponds very closely to what humans perceive as 'semantically close', we perceive this as parroting.
If this instance is somewhat distant but still connected to what humans perceive as 'semantically close', we perceive this as creativity.
If this instance of 'statistically close' is very different from what humans perceive as 'semantically close', we perceive this as an error, a glitch, a fluke, or the model not working well.
This is complicated by two things:
(a) we have a very limited understanding of what 'semantically close' means.
(b) we have a very limited understanding of how human brains work.
Edit: formatting
- miltondts 4y agoPerhaps the most important notion of semantics is that of referent. Pretty sure you can't develop that without an agent that can interact with the environment.
- visarga 4y ago> If this instance of 'statistically close' corresponds very closely to what humans perceive as 'semantically close', we perceive this as parroting. Could it be that with scaling the statistical model can become good enough for semantics? Quantity has a quality all its own / The map is the territory. I believe we're seeing emergence from low level statistical patterns to semantics, especially in GPT-3, DALL-E and AlphaGo.