> But there’s also been a lot of research suggesting most SOTA dense networks are arbitrarily replicatable with sparse networks I'm not sure if its related, bu

> But there’s also been a lot of research suggesting most SOTA dense networks are arbitrarily replicatable with sparse networks I'm not sure if its related, but would this work kind of how armadillo can do singular value decomp [0] of a matrix by embedding arbitrary n by m matrix X in a higher dimensional n+m by n+m null matrix M? [0] http://arma.sourceforge.net/docs.html#svds http://arma.sourceforge.net/docs.html#svds