Sparsity is antithetical to performance, unfortunately, in any kind of realistic computer architecture unless you get _really_ sparse, or at least block-sparse

Sparsity is antithetical to performance, unfortunately, in any kind of realistic computer architecture unless you get _really_ sparse, or at least block-sparse (s.t. entire blocks of computation could be skipped), and you're not doing sgemm()-like things. So while this looks great on paper (and the paper is quite nice), in practice quantized, dense MobileNets will continue to dominate.