None of the major aspects of deep learning came from manifolds though. It is primarily linear algebra, calculus, probability theory and statistics, secondarily

None of the major aspects of deep learning came from manifolds though. It is primarily linear algebra, calculus, probability theory and statistics, secondarily you could add something like information theory for ideas like entropy, loss functions etc. But really, if "manifolds" had never been invented/conceptualized, we would still have deep learning now, it really made zero impact on the actual practical technology we are all using every day now.