14 ms·

DeepMind Memory Task Suite

87 points by davidfoster 7y ago

PaulRobinson 7y ago
I was surprised to see that these are based in Unity. Is there a growing community of machine-learning research in Unity, and if so, what's prompting that?
- kuu 7y ago
  They did a deal a year ago: https://blogs.unity3d.com/es/2018/09/26/unity-and-deepmind-partner-to-advance-ai-research/ https://blogs.unity3d.com/es/2018/09/26/unity-and-deepmind-p...
- one_electron 7y ago
  same here, although i know unity has been staffing up their ml team eg arthur juliani doing good work at unity. more generally speaking, i think there is a clear need for reliable, robust simulators in ml. (openai released a few interesting environments a few years back but adoption seems to have plateaued, from my perspective.)
- glial 7y ago
  I saw these folks talk at a conference last year and demo some of this work. There is a strong push towards asking computers to do tasks that humans and animals do in psychology and neuroscience experiments: navigating a maze, finding a platform submerged in water, etc. Many of these tasks require memory (see also: playing Montezuma's Revenge). Part of the goal is to reach parity with humans on certain tasks. Another part is to help understand how cognition works by building it from scratch and cross-referencing results with human/animal results. By using Unity, they can create a virtual environment that mimics the real physical experiments. I think this is good, as one big 'cheat' in many AI projects is representing the 'state' of the system in a way that implicitly captures expert domain knowledge - i.e. about what parts of the environment are significant with regards to performing the task. Letting the agent 'experience' a virtual world in a 'raw' form allows it to figure out what's salient - what it needs to remember - which animals also have to do in experiments. Plus, Unity videos demo really well.
- TaylorAlexander 7y ago
  Traditional machine learning simulators can be hard to work with. Meanwhile unity has been pushing to support machine learning development, and their world construction tools are great. It’s a lot easier to build a little car and a suitable world in unity than it is in pybullet, for example.

87 points by davidfoster 7y ago

I was surprised to see that these are based in Unity. Is there a growing community of machine-learning research in Unity, and if so, what's prompting that?

kuu 7y ago
They did a deal a year ago: https://blogs.unity3d.com/es/2018/09/26/unity-and-deepmind-partner-to-advance-ai-research/ https://blogs.unity3d.com/es/2018/09/26/unity-and-deepmind-p...
one_electron 7y ago
same here, although i know unity has been staffing up their ml team eg arthur juliani doing good work at unity. more generally speaking, i think there is a clear need for reliable, robust simulators in ml. (openai released a few interesting environments a few years back but adoption seems to have plateaued, from my perspective.)
glial 7y ago
I saw these folks talk at a conference last year and demo some of this work. There is a strong push towards asking computers to do tasks that humans and animals do in psychology and neuroscience experiments: navigating a maze, finding a platform submerged in water, etc. Many of these tasks require memory (see also: playing Montezuma's Revenge). Part of the goal is to reach parity with humans on certain tasks. Another part is to help understand how cognition works by building it from scratch and cross-referencing results with human/animal results. By using Unity, they can create a virtual environment that mimics the real physical experiments. I think this is good, as one big 'cheat' in many AI projects is representing the 'state' of the system in a way that implicitly captures expert domain knowledge - i.e. about what parts of the environment are significant with regards to performing the task. Letting the agent 'experience' a virtual world in a 'raw' form allows it to figure out what's salient - what it needs to remember - which animals also have to do in experiments. Plus, Unity videos demo really well.
TaylorAlexander 7y ago
Traditional machine learning simulators can be hard to work with. Meanwhile unity has been pushing to support machine learning development, and their world construction tools are great. It’s a lot easier to build a little car and a suitable world in unity than it is in pybullet, for example.