3 ms·
A Hinton inspired speculation about a Robot that plans & communicates. I posit that general A.I. must be embodied to develop, it must learn from the real world
by deepnet 10y ago
A Hinton inspired speculation about a Robot that plans & communicates.
I posit that general A.I. must be embodied to develop, it must learn from the real world by interacting with it and learn by trial and error.
Deep learning is a huge leap for AI. It learns best from raw data. Babies learn motor control & input interpretation first[1]. Moravec's paradox proposes learning these basics are the hard foundation that higher levels of reason build on.
Abeel and Levine's work[2] where robots learn robust functions to map from pixels to motor torques for domestic tasks show solutions built on features learnt from raw data are more resilient than hand-engineered ones. These trajectories through motor-torque space to produce a desired goal are intriguingly like planning.
Mikolov's[3] Word2vec & Radford's Image Vectors[4] produce semantic spaces where vector math is akin to reasoning. Higher level control could be achieved through vector algebras deriving actions and things directly from the robots internal vector space of motor-torques and raw-pixels
Thus internal vectors are like thoughts[5] which can interpret, reason, plan, and control.
Karpathy shows internal vectors can bridge modalities from words to pictures[6]. If the higher level control vectors of actions and things could translate to the modality of language as verbs and nouns, perhaps the robot could discuss its plans, and receive orders.
[1] - Thelen's Infant Development http://www.ncbi.nlm.nih.gov/pubmed/17107442 http://www.ncbi.nlm.nih.gov/pubmed/17107442
[2] - Levine, Finn, Darrel, Abeel http://arxiv.org/abs/1504.00702 http://arxiv.org/abs/1504.00702 &
[2b] - Distributed Grasp Learning http://googleresearch.blogspot.co.uk/2016/03/deep-learning-for-robots-learning-from.html http://googleresearch.blogspot.co.uk/2016/03/deep-learning-f...
[3] - Mikolov, Chen, Corrado, Dean http://arxiv.org/abs/1301.3781 http://arxiv.org/abs/1301.3781
[4] - Radford, Metz, Chintala https://github.com/Newmu/dcgan_code#arithmetic-on-faces https://github.com/Newmu/dcgan_code#arithmetic-on-faces
[5] - Hinton https://youtu.be/IcOMKXAw5VA?t=32m55s https://youtu.be/IcOMKXAw5VA?t=32m55s
[6] - Karpathy https://youtu.be/ZkY7fAoaNcg?t=38m31s https://youtu.be/ZkY7fAoaNcg?t=38m31s