3 ms·
Consciousness is awareness of itself. Inner monologue is self referential. If you can simulate it you will not be able to distinguish real one from simulated on
by mirekrusin 4y ago
Consciousness is awareness of itself. Inner monologue is self referential. If you can simulate it you will not be able to distinguish real one from simulated one similar to how you can't distinguish native speaker's translation from machine translation using black box test.
At this point - does it mean anything if something is "real" or "simulated"? If your only test is black box test where you can't distinguish black boxes anymore - your testing method is exhausted.
Perception, imagination, future reward estimation can be inspected by dumping inner dialogue - it's a subset of things people are already looking at to evaluate overall performance in one shot examples. It's when those things gain inner loop ability where it gets interesting.
- braindead_in 4y ago> Consciousness is awareness of itself. Inner monologue is self referential. ChatGPT is definitely aware that it exists. In humans, the self-referential inner monologue activates when the mind is idle. The Default Mode Network is responsible for that processing. Can it be that ChatGPT is "thinking" when it's idle as well?
- mirekrusin 4y agoI think you're conflating self-awareness with self-...acknowledgement? Ie. python script foo.py that prints content of ./foo.py is not self aware. Self awareness needs notion of time and self referential memory. ChatGPT doesn't exist when it's idle. It's activated when transforming input into next potential token (list of tokens with probabilities). Ie. it's just sophisticated pure function mapping input -> list of tokens with probabilities. What's incredible is that it actually works when you keep repeating it. Notion of thinking time doesn't exist for it. It can for example branch in the middle. You can calculate one token in this data-center, next one on another continent etc.