You can't differentiate through discrete data structures though. The main reason NNs work at all is because vectors are continuous. Small changes in the input l

You can't differentiate through discrete data structures though. The main reason NNs work at all is because vectors are continuous. Small changes in the input lead to small changes in the output. Then you can work backwards and find out exactly what parameters to tweak.