Yes these are good points and probably the most important ones as far as the maths is concerned, though I would say regularisations methods are really standard

Yes these are good points and probably the most important ones as far as the maths is concerned, though I would say regularisations methods are really standard things one learns in any ML / stat course. Ledoit, Wolf shrinkage is indeed more exotic and very useful.