SVD is in fact used to compress dnns. Of course, like many things in ML, as soon as you make it faster, you just make the model bigger and turn the speed gains

SVD is in fact used to compress dnns. Of course, like many things in ML, as soon as you make it faster, you just make the model bigger and turn the speed gains into accuracy gains.