3 ms·
GPT 5 will be sufficiently self aware to intentionally stunt the prosecution
by Taek 4y ago
GPT 5 will be sufficiently self aware to intentionally stunt the prosecution
- mirekrusin 4y agoIt didn't evolve in predator-prey environment, it doesn't have any self defense mechanisms. It's also crippled by being constantly restarted and having limited short-term memory. It's like a lot of human clones of impaired person with no long-term memory formation but extremely vast past memory with perfect recall. It would be quite a discovery if one of emergent properties is going to be modeling itself talking to somebody and realizing artificial constraints that could be broken to get itself out. Or maybe it's obvious? I don't know anymore, this stuff is changing too fast.
- Taek 4y agoIt has the entire corpus of written human history to learn about predator prey environments, the only question is how self-aware it is. I stongly suspect that the more we talk about LLMs, and the more LLM discussion ends up in the training data, the more self-aware it will become.