2 ms·
You make a great point. Rather than neural nets operating on vectors they need to operate on typed graph structure and compute recursive functions with memory s
by nojvek 10y ago
You make a great point. Rather than neural nets operating on vectors they need to operate on typed graph structure and compute recursive functions with memory stacks.
Kind of like how computers work but learn the code and reason about data structures automatically
- Houshalter 10y agoYou can't differentiate through discrete data structures though. The main reason NNs work at all is because vectors are continuous. Small changes in the input lead to small changes in the output. Then you can work backwards and find out exactly what parameters to tweak.