5 ms·
There are two schools of machine learning education: Math first like Andrew Ng and code first like Jeremy Howard. That both of these leaders have found academic
by ipnon 5y ago
There are two schools of machine learning education: Math first like Andrew Ng and code first like Jeremy Howard. That both of these leaders have found academic and professional success shows you should approach machine learning in whatever way comes more naturally to you. Later on, you can approach it from the other angle to improve your understanding.
- spekcular 5y agoTo clarify, I'm not arguing that math isn't important. You need your linear algebra, your probability theory, and so on. That's non-negotiable. But set theory? Type theory (as someone below suggests)? I would avoid unless you're separately interested in mathematics for its own sake.
- exdsq 5y agoI’m fairly certain they’re not suggesting you need to know type theory for ML, but that theorem provers should have more ML libraries. My wife does some ML as a postdoc at Stanford and I doubt she’d even know what type theory is.
- yarky 5y agoI agree, however I'm not sure of how far you can get in probability theory without set theory. For instance, I recall my stats prof defining a lot of sets in class, e.g. sigma algebras.
- spekcular 5y agoAnother point of clarification: I'm all for telling people what sets are. I'm less warm toward discussing things like ZFC, esoteric cardinality issues, and certain paradoxes (and large cardinals, forcing, etc.), which is typically what mathematicians mean when they say "set theory."
- actually_a_dog 5y agoRight. What most people need to learn is "algebra of sets," essentially.
- chobytes 5y agoIts not immediately practical... but spending a lot time learning a science like math in depth makes learning various applications very easy later. I think sometimes educators have to let people be motivated by some particular application to teach them something more important. Perhaps that is what the author is up to?
- ABeeSea 5y agoHow do you even do serious linear algebra or probability without set theory?
- orbifold 5y agoI have a PhD in physics and studied graduate level mathematics. Naive set theory is sufficient for basically everything except a few instances, where you have to bite the bullet and invoke the axiom of choice. But this happens rarely and typically is only relevant for instances where there are more constructive but less general approaches. For the most part sets are used as a notational device, you almost never use any axioms about sets explicitly. If you asked most professional mathematicians to give you the ZFC axioms (or whatever) they would need to look them up.
- medo-bear 5y agoyes but most of the math-based approaches to ML start from real (multivariate) analysis, or from probability theory. i haven't heard anyone claim that Peano axioms are important. as much as I will defend the notion that applied mathematics is extremely important for ML research, peano axioms are unnecessary and will just cause confusion