4 ms·
What else do you use to train the network?
by iskander 11y ago
What else do you use to train the network?
- bra-ket 11y agorandom matrices + svd: http://www.ntu.edu.sg/home/egbhuang/ http://www.ntu.edu.sg/home/egbhuang/
- gcr 11y agoI would be very interested to see if this approach outperforms more conventional deep networks trained with backpropagation. It's important to note that (from what I understand) this paper seems to focus on building single-layer NNs, which are quite different from the behemoth AlexNet that this article focuses on.
- deleted 11y ago[deleted]
- Fede_V 11y agoVery early on, people experimented heavily with non-gradient based optimization (genetic algorithms and the like) to optimize neural networks, but the results were rather poor. For very large parameter spaces, gradient based optimization is really the only game in town. There's also lots of clever tricks (gradient clipping, momentum, adagrad, etc) that are involved in optimizing the convergence.