2 ms·
With a human brain you're got 1) A huge stream on sensory data only some of which gets promoted to conscious awareness. 2) Some of that raw data and other con
by Symmetry 3y ago
With a human brain you're got
1) A huge stream on sensory data only some of which gets promoted to conscious awareness.
2) Some of that raw data and other conscious outputs are persisted into working, short, and long term memory.
3) And your consciousness works recursively using (2) as well as (1) as inputs.
All the stuff in GPT that gets called "memory" in machine learning seems much more like (1) and it lacks any ability to persist data outside its context window so we're still missing something.