2 ms·
Setting aside any objections one may raise regarding the term emergence[1], the objective of this post was to discuss how while GPT-x alone cannot become an age
by leogao 6y ago
Setting aside any objections one may raise regarding the term emergence[1], the objective of this post was to discuss how while GPT-x alone cannot become an agent, its internal representations can be harnessed to create an agent. Note that human-like emotions and qualia are not in any way necessary for an artificial agent.
[1] https://www.lesswrong.com/posts/8QzZKw9WHRxjR4948/the-futility-of-emergence https://www.lesswrong.com/posts/8QzZKw9WHRxjR4948/the-futili...
- gnramires 6y agoI have to disagree with the term objections; my usage here has a precise meaning: when you train large (and efficient) neural networks, abstract internal representations emerge. Emerge simply means they weren't programmed explicitly, but the training procedure and other properties are so it will arise. I agree that's a plausible way to build an agent. In my line of questioning, I would wonder if it could really perform in the real world, due to limitation of corpus, and really lacking training as an agent (and not just a text predictor). This could be addressed using simulated (and possibly multi-agent) training environments and the like.