3 ms·

Is it in particular the dot product (correlation) in MLPs that prevents them from inferring all causal structures in the data? So, instead of template matching

• eli_gottlieb 9y ago
  Again, it's the lack of counterfactuals: the ability to intervene on a node and cut it off from its parents, then see what happens, and the ability to perform inferences over discrete spaces.
  • mannigfaltig 9y ago
    Are there any concrete attempts at transferring this concept to MLPs? E.g. by overriding the values of particular nodes/features by feedback connections?
    • eli_gottlieb 9y ago
      No, because neural nets do not work that way, even when they output actions. Making things More Neural doesn't make them better, and AFAIK, not everything good can be made More Neural.
      • mannigfaltig 9y ago
        > Because neural nets do not work that way Are there works that expose this limitation of MLPs more formally? >not everything good can be made More Neural. Neural networks are universal function approximators, so you probably mean not everything good can be made with MLPs trained by gradient descent? >It's the lack of [...] the ability to perform inferences over discrete spaces. How would you judge the extent to which AlphaGo has learned to react to single discrete changes in the input. It seems that it learned very well to react very sharply to whether a single stone is placed at a strategically significant position.