3 ms·
Would this have implications for using ANNs on recursive structures (trees and graphs)? Their "position encoding" seems a little contrived, but may be amenable
by chriswarbo 9y ago
Would this have implications for using ANNs on recursive structures (trees and graphs)? Their "position encoding" seems a little contrived, but may be amenable to a more complex positioning scheme (e.g. paths from a root node).
Whilst there are "standard" approaches in computer vision ("CNNs applied to <foo>") and sequence processing ("LSTM RNNs applied to <foo>"), there doesn't seem to be any "standard" for variable-size, recursively-structured data. Sure there's recursive ANNs, backpropagation-through-structure, etc. but they all seem like one-off inventions, rather than accepted problem-solving tools.
- sdenton4 9y agoSeq2Seq is kind of a standard, but also strikes me as pretty hacky. The network has an encoder and a decoder mode, reads until it finds an end of input signal, then switches to decode mode. This is how absolutely nothing works in nature.