3 ms·

The "Beyond Deep Learning" section of the article talks about this approach: > A more radical possibility is to give up trying to tackle the problem at hand by

The "Beyond Deep Learning" section of the article talks about this approach: > A more radical possibility is to give up trying to tackle the problem at hand by training just one big network and instead have multiple networks work in tandem. In June 2018, the DeepMind team published an example they call the Generative Query Network architecture (7, http://science.sciencemag.org/content/360/6394/1204?ijkey=018d59fb09956eecd61aa38f0d028d7b9d065283 http://science.sciencemag.org/content/360/6394/1204?ijkey=01...), which harnesses two different networks to learn its way around complex virtual environments with no human input. One, dubbed the representation network, essentially uses standard image-recognition learning to identify what’s visible to the AI at any given instant. The generation network, meanwhile, learns to take the first network’s output and produce a kind of 3D model of the entire environment—in effect, making predictions about the objects and features the AI doesn’t see. For example, if a table only has three legs visible, the model will include a fourth leg with the same size, shape, and color.

tabtab 8y ago
If we want "dissectable" AI, we will almost certainly have to break them up into modules or semi-independent sub-systems. While one-big-network may technically be able to do the job, it's harder for most humans to study, tune, and tame such a system. We like to know who to sue if bots go kaflooey :-)
- hsikka 8y ago
  I'm really excited by the concept of modular neural networks
  - tabtab 8y ago
    It doesn't have to be just NN's. For example, stereoscopic vision (triangulation) or LIDAR can create a 3D depth map model (perhaps with certainty weights). NN's can also create one based on mass 3D training on flat images (non-stereo). The two models can be compared, and alternative pattern-match candidates can be explored for the spots that don't match well. I suppose the stereoscopic vision system could use NN's, but the implementation can be swapped for something else as long as the result (interface) is a depth map. You could switch it from LIDAR to multi-eye stereoscopic translation and vice versa. The interface between the parts is something human analysts can inspect and relate to. You may also have a 3rd module that attempts to model the scene using 3D rendering of the "guessed" objects (using a database of known objects) from the flat-image NN and depth-map first pass, using the match/non-match feedback to test yet more guesses. (Certain objects with semi-random shapes like a pile of cloth or mountains may be excluded from known-object-matching, at least as a test candidate.) There might even be a genetic algorithm to "breed" the best 3D-rendered model that fits the depth map, the flat image, and the top flat-NN candidates.

tabtab 8y ago

If we want "dissectable" AI, we will almost certainly have to break them up into modules or semi-independent sub-systems. While one-big-network may technically be able to do the job, it's harder for most humans to study, tune, and tame such a system. We like to know who to sue if bots go kaflooey :-)

hsikka 8y ago
I'm really excited by the concept of modular neural networks
- tabtab 8y ago
  It doesn't have to be just NN's. For example, stereoscopic vision (triangulation) or LIDAR can create a 3D depth map model (perhaps with certainty weights). NN's can also create one based on mass 3D training on flat images (non-stereo). The two models can be compared, and alternative pattern-match candidates can be explored for the spots that don't match well. I suppose the stereoscopic vision system could use NN's, but the implementation can be swapped for something else as long as the result (interface) is a depth map. You could switch it from LIDAR to multi-eye stereoscopic translation and vice versa. The interface between the parts is something human analysts can inspect and relate to. You may also have a 3rd module that attempts to model the scene using 3D rendering of the "guessed" objects (using a database of known objects) from the flat-image NN and depth-map first pass, using the match/non-match feedback to test yet more guesses. (Certain objects with semi-random shapes like a pile of cloth or mountains may be excluded from known-object-matching, at least as a test candidate.) There might even be a genetic algorithm to "breed" the best 3D-rendered model that fits the depth map, the flat image, and the top flat-NN candidates.