3 ms·
Revolutionary paper indeed, if this idea generalizes to bigger deeper networks! (Then) why hasn't it been discovered before? It's like the Cambrian explosion of
by singularity2001 12y ago
Revolutionary paper indeed, if this idea generalizes to bigger deeper networks! (Then) why hasn't it been discovered before? It's like the Cambrian explosion of neuron networks, very exciting times.
- singularity2001 12y agookay but how does this save computing time? computing random matrices is not faster than (implicitly) transposing the weight matrix. so it only has philosophical implications, right? Ok, got it: It will simplify the approach of how to create hardware based neural networks! no more complicated look-ups of the transposed weight matrix needed.