6 ms·

It's not clear to me who the target audience is for this book. As someone with a graduate degree but not a mathematical background, I'm comfortable reading acad

It's not clear to me who the target audience is for this book. As someone with a graduate degree but not a mathematical background, I'm comfortable reading academic papers, but a lot of this feels over my head. So it reads to me like it's a quick refresher or reference for people who already learned this stuff at some point, rather than an introduction. But the preface says this is to be "a book on Mathematics for Machine Learning that motivates people to learn mathematical concepts." As a sidebar, it has always seemed to me that there is a giant gulf between truly beginner-friendly math books, which are aimed at children, and introductory math books aimed at adults. The latter almost always read like foreign language textbooks where you must first know the language before you can start, while the former are too elementary. I'd love to find "College level Math for English Majors" or something of the like, if anyone knows of such a book :)

abhishekjha 9y ago
At this point we might benefit a lot from a forum where mathematical concepts are discussed for a particular application in the most explicit ways and not just question and answers. We can then build up on that to further the mathematical concepts and also to rope in more people into proper Machine Learning domain. Is this objective a little too unrealistic to obtain?
- jacobolus 9y ago
  That forum has existed for centuries, and is called a university.
  - foo101 9y ago
    How is that relevant? Many of us are not going to spend our entire lives in a university.
    - jacobolus 9y ago
      The general way to master a large pile of difficult abstractions is to study for years, ideally in a context focused on that study. This can be done independently of any expert feedback (e.g. by reading books, watching lecture videos, and doing a big pile of ungraded self-assigned homework problems), but it’s not easy or typically very efficient. For the majority of people who want to deeply learn mathematical topics but who are starting from a low level, the most efficient and effective advice for them is to go attend a university. An online discussion forum isn’t typically going to cut it, IMO. People won’t be at the same level, won’t be working on the same topics, won’t have the same goals and interests, the same level of commitment, coordinated schedules, etc. This has been tried many times, but I have not heard many successful reports. Online discussion forums are great for handling independent limited-scope questions–answers (including for current university students), and okay for coordinating research efforts among people who are already experts, but in general are not very effective for getting a group of people to diligently work through years of prerequisite material in an organized fashion. You shouldn’t spend your life in a university, but if you have a goal of learning advanced mathematics, you might benefit from spending a few years there. YMMV. As an alternative, if you can find an expert tutor/coach to meet with one-on-one on a regular basis, that is even better than a formal course. But that is expensive and hard to scale.
      - jimhefferon 9y ago
        Very well put. > it’s not easy or typically very efficient It is also very possible for folks to think they have it right, and go off in entirely wrong directions. In my experience it is likely, even in quite good and hard-working students. I teach an inquiry-based proofs class and so I sit through the students's discussion. Even on material that would be considered trivial in many of the books mentioned here, there are people saying aloud things in that discussion that are just simply wrong. It is not that these folks are dummies, it is that this stuff is hard. I'm not a people person but one thing I've seen from this class is that a lot of learning is about community. It makes a big difference.
      - mindcrime 9y ago
        You shouldn’t spend your life in a university, but if you have a goal of learning advanced mathematics, you might benefit from spending a few years there. YMMV. The problem is, that simply isn't possible / practical for many people. Assuming we're talking about people who are career professionals who are already past their first (and maybe only) stint at a university, most people just don't have the free time (and other resources) to sit in classes at a university. Especially since most universities still cater almost exclusively to "traditional" students who take classes in person, during the day. If universities made more night classes available, or more online/hybrid classes, I could buy this. But for a lot of us, the best we can do is some combination of "watch Youtube videos, do MOOC's, self-study, do ungraded problems, and ask for help on Internet forums". That said, not all problems you do on your own have to be exactly "ungraded". For many mathematical subjects you can find books of exercises that include the answers so you can "grade" yourself (assuming you can resist the temptation to cheat and look at the answers first), or you can find previous years problem sets and exams on many course websites. Yeah, learning the stuff outside of a university setting is probably harder in some sense, but it's not impossible. And if that avenue is the only one available to somebody, then it is - by definition - the best avenue available to them.
    - dsacco 9y ago
      This might sound callous, but most of us are not going to master advanced mathematics or theoretical computer science. If you want to self-study, all the material you could ever hope to need is available in a mulitude of books targeted to various levels of prior experience and with many different styles of exposition. If you want to study with others, this is precisely what college is for. People who don’t want to study in a college setting basically don’t want to study in a group setting in general, because the college setting actually is the most efficient group setting. I think most people underestimate the sheer vastness of the material you have to learn and the requisite time you need to learn it. Reading isn’t enough, you have to do it - over and over. It’s frankly a slog, and there’s no more efficient way than being immersed in coursework. The entire benefit of a course structure is the instructor. The community forum helps, but really it’s an extension of the instructor. A qualified instuctor can quickly resolve a complex question that might take you hours or days to (maybe incorrectly) answer yourself. If you’re capable of learning genuinely unfamiliar math without an instructor, that means you have sufficient mathematical maturity that you don’t need a group forum. At that point it’s actually more efficient to self-study. I get the sense people believe mathematicians are pretentious when they say things like this, but I think that’s uncharitable. They typically give advice like this because they have a significant amount of personal experience and know very well what tends to work (and how efficiently it works).
- dsacco 9y ago
  What does “most explicit ways” mean? Do you mean in the most straightforward language possible, with as much jargon as possible removed? Do you mean extremely patient exposition? Do you mean a first principles approach that builds advanced probability theory, linear algebra and statistics from set theory, then dives into machine learning? Murphy’s Machine Learning: A Probabilistic Perspective is just over 1000 pages long. It’s an exceptionally good book for the mathematical theory behind machine learning. What would this book look like under your proposal? If we add in Axler’s Linear Algebra Done Right and Chung’s A First Course in Probability Theory, we’re adding another 350 pages or so each. Both of those books have prerequisites, and Murphy’s book isn’t the top either. In my opinion your proposal is unrealistic, yes. I don’t mean for that to sound harsh, I just don’t see a way to achieve what you’re asking for without making a monolithic tome larger than Knuth’s The Art of Computer Programming, and potentially even more diverse in scope.
jonnybgood 9y ago
There are some decent intro books for adults out there if you don’t care about the branch. Honestly, if you’re looking for intro math books you really shouldn’t care too much about the branch. I think what’s more important is to develop mathematical thinking. Here’s some off the top of my head. I really think these will help you build a good foundation for mathematical thinking. Concrete Mathematics by Graham, Knuth, Patashnik Spivak’s Calculus How to Prove It by Velleman Polya’s How to Solve It E.T. Jaynes’ Probability Theory Conceptual Mathematics by Lawvere and Schanuel
- bkcooper 9y ago
  Concrete Mathematics Spivak Jaynes All good books, all pitched at a level that is very ill suited for what is being asked for. To the GP, "math for English majors" is a common enough course schema that I think looking at a few syllabi might score you something.
  - jonnybgood 9y ago
    I specifically mentioned those because they have little to no prerequisites other than high school math which I interpret can be read by any non-math major. They’re very self-contained but have very little hand-holding. I think just absorbing a little of these books will establish a decent foundation.
    - jacobolus 9y ago
      Concrete Mathematics is pitched at graduate students in computing. Spivak’s Calculus is an introductory real analysis book pitched at undergraduates who have gone through a computational calculus course already and want to study the subject more formally and rigorously; it has many difficult problems and would generally benefit greatly from the structure and expert feedback of a university course. Jaynes’s book is probably most relevant to science students who are at least at the advanced undergraduate level. How to Solve It is a dictionary of heuristic problem-solving techniques which is most useful to someone who is already (deeply) familiar with mathematical problem solving, and wants to codify their existing methods. Even advanced undergraduate math students who read it aren’t going to fully understand the book IMO; I would recommend Pólya’s other books (Mathematics and Plausible Reasoning, Mathematical Discovery), or maybe start with a gentler book like Mason, Burton, & Stacey, Mathematical Thinking.
SpaceManNabs 9y ago
I felt the same. It is a decent enough refresher though! Machine learning lends itself to easily learning additional pieces of math once you have a nice foundation, and it is nice enough that the foundation is pretty small---vector calc, (mostly) real analysis, linear algebra (it helps if you know infinite but orthogonal eigenfunctions), little bit of physics knowledge (statistical models and hamiltonians), and a little bit of differential geometry. Unfortunately, that foundation is slowly getting bigger. Read some papers in topological data analysis recently. Category theory is crawling in!
atomicnumber1 9y ago
Ok, I don't know about book but 3blue1brown on youtube has some really cool videos on intermediate maths. He's videos are more about understanding the underlying concepts rather than formulas. https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw/playlists https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw/pla...
gtani 9y ago
The target audience would be people that have roughly 2 years of undergrad math, the 4 semester calc sequence or high school equivalent, probability/stats, linear algebra, some computational courses using e.g. Numerical Analysis by Burden/Faires. If you look in Goodfellow et al's Deep Learning book, Murphy's Machine Learning text and others mentioned here (Learning from Data, Shalev-Shwartz/Ben-David) the prereq's are always some variation of above and I think you could do a lot of the above at U.S. community colleges, at least the CC's around me. Frankly, you'd have to do a bunch of self study beyond CC and there's no shortcut/royal road. So the key is self study, that's a discipline anyone that wants to do Data Science/machine learning for real needs
aje403 9y ago
There is no free lunch, sorry. Either work for it for years or don’t. Or wait for brain implants or something.
dfan 9y ago
It looks to me like it's pitched approximately at third-year undergraduates who have a couple of years of a college math background, and is meant to pull them up to a level where they can fluently work with the more advanced concepts used in machine learning. The route for someone with no (or very little) math background is a lot longer, and I don't think this book is trying to provide it. I think that one either has to 1) bite the bullet and learn a year or two of undergrad math first, which provides the necessary foundation for this stuff, then learn this for real; or 2) be content with understanding and using machine learning at a hand-wavy level (which I am not denigrating). It might be nice to have a "hand-wavy machine learning" book around (there are certainly enough blog posts of that sort), but this isn't trying to be it.
- monotypical 9y ago
  It seems to follow the 4th year/masters course of the same name taught by one of the authors (Dr Marc Deisenroth) at Imperial College London: http://www.imperial.ac.uk/computing/current-students/courses/496/ http://www.imperial.ac.uk/computing/current-students/courses... The course requires a 1st year linear algebra course and a 2nd year statistics course, which might explain why this book doesn't cover some of the basic concepts
deleted 9y ago
[deleted]
ivan_ah 9y ago
I have two book recommendations that seem like exactly what you're looking for. Both are written by me, so I'm totally biased. The NO BULLSHIT guide to MATH & PHYSICS is a 3-in-1 combo book that includes a high school math review, mechanics, and calculus. Preview: https://minireference.com/static/excerpts/noBSguide_v5_preview.pdf https://minireference.com/static/excerpts/noBSguide_v5_previ... The NO BULLSHIT guide to LINEAR ALGEBRA covers all the standard LA material, and also discusses lots of interesting applications (graphs, graphics, crypto, quantum computing). Preview: https://minireference.com/static/excerpts/noBSguide2LA_preview.pdf https://minireference.com/static/excerpts/noBSguide2LA_previ... I put a lot of effort into making them with an "easy ramp up" so anyone with basic math background can pick up. If you don't remember you high school math in details, you can still handle. You can buy print versions on amazons or ebook on gumroad. See website for links: https://minireference.com/ https://minireference.com/

abhishekjha 9y ago

At this point we might benefit a lot from a forum where mathematical concepts are discussed for a particular application in the most explicit ways and not just question and answers. We can then build up on that to further the mathematical concepts and also to rope in more people into proper Machine Learning domain. Is this objective a little too unrealistic to obtain?

jacobolus 9y ago
That forum has existed for centuries, and is called a university.
- foo101 9y ago
  How is that relevant? Many of us are not going to spend our entire lives in a university.
  - jacobolus 9y ago
    The general way to master a large pile of difficult abstractions is to study for years, ideally in a context focused on that study. This can be done independently of any expert feedback (e.g. by reading books, watching lecture videos, and doing a big pile of ungraded self-assigned homework problems), but it’s not easy or typically very efficient. For the majority of people who want to deeply learn mathematical topics but who are starting from a low level, the most efficient and effective advice for them is to go attend a university. An online discussion forum isn’t typically going to cut it, IMO. People won’t be at the same level, won’t be working on the same topics, won’t have the same goals and interests, the same level of commitment, coordinated schedules, etc. This has been tried many times, but I have not heard many successful reports. Online discussion forums are great for handling independent limited-scope questions–answers (including for current university students), and okay for coordinating research efforts among people who are already experts, but in general are not very effective for getting a group of people to diligently work through years of prerequisite material in an organized fashion. You shouldn’t spend your life in a university, but if you have a goal of learning advanced mathematics, you might benefit from spending a few years there. YMMV. As an alternative, if you can find an expert tutor/coach to meet with one-on-one on a regular basis, that is even better than a formal course. But that is expensive and hard to scale.
    - jimhefferon 9y ago
      Very well put. > it’s not easy or typically very efficient It is also very possible for folks to think they have it right, and go off in entirely wrong directions. In my experience it is likely, even in quite good and hard-working students. I teach an inquiry-based proofs class and so I sit through the students's discussion. Even on material that would be considered trivial in many of the books mentioned here, there are people saying aloud things in that discussion that are just simply wrong. It is not that these folks are dummies, it is that this stuff is hard. I'm not a people person but one thing I've seen from this class is that a lot of learning is about community. It makes a big difference.
    - mindcrime 9y ago
      You shouldn’t spend your life in a university, but if you have a goal of learning advanced mathematics, you might benefit from spending a few years there. YMMV. The problem is, that simply isn't possible / practical for many people. Assuming we're talking about people who are career professionals who are already past their first (and maybe only) stint at a university, most people just don't have the free time (and other resources) to sit in classes at a university. Especially since most universities still cater almost exclusively to "traditional" students who take classes in person, during the day. If universities made more night classes available, or more online/hybrid classes, I could buy this. But for a lot of us, the best we can do is some combination of "watch Youtube videos, do MOOC's, self-study, do ungraded problems, and ask for help on Internet forums". That said, not all problems you do on your own have to be exactly "ungraded". For many mathematical subjects you can find books of exercises that include the answers so you can "grade" yourself (assuming you can resist the temptation to cheat and look at the answers first), or you can find previous years problem sets and exams on many course websites. Yeah, learning the stuff outside of a university setting is probably harder in some sense, but it's not impossible. And if that avenue is the only one available to somebody, then it is - by definition - the best avenue available to them.
  - dsacco 9y ago
    This might sound callous, but most of us are not going to master advanced mathematics or theoretical computer science. If you want to self-study, all the material you could ever hope to need is available in a mulitude of books targeted to various levels of prior experience and with many different styles of exposition. If you want to study with others, this is precisely what college is for. People who don’t want to study in a college setting basically don’t want to study in a group setting in general, because the college setting actually is the most efficient group setting. I think most people underestimate the sheer vastness of the material you have to learn and the requisite time you need to learn it. Reading isn’t enough, you have to do it - over and over. It’s frankly a slog, and there’s no more efficient way than being immersed in coursework. The entire benefit of a course structure is the instructor. The community forum helps, but really it’s an extension of the instructor. A qualified instuctor can quickly resolve a complex question that might take you hours or days to (maybe incorrectly) answer yourself. If you’re capable of learning genuinely unfamiliar math without an instructor, that means you have sufficient mathematical maturity that you don’t need a group forum. At that point it’s actually more efficient to self-study. I get the sense people believe mathematicians are pretentious when they say things like this, but I think that’s uncharitable. They typically give advice like this because they have a significant amount of personal experience and know very well what tends to work (and how efficiently it works).
dsacco 9y ago
What does “most explicit ways” mean? Do you mean in the most straightforward language possible, with as much jargon as possible removed? Do you mean extremely patient exposition? Do you mean a first principles approach that builds advanced probability theory, linear algebra and statistics from set theory, then dives into machine learning? Murphy’s Machine Learning: A Probabilistic Perspective is just over 1000 pages long. It’s an exceptionally good book for the mathematical theory behind machine learning. What would this book look like under your proposal? If we add in Axler’s Linear Algebra Done Right and Chung’s A First Course in Probability Theory, we’re adding another 350 pages or so each. Both of those books have prerequisites, and Murphy’s book isn’t the top either. In my opinion your proposal is unrealistic, yes. I don’t mean for that to sound harsh, I just don’t see a way to achieve what you’re asking for without making a monolithic tome larger than Knuth’s The Art of Computer Programming, and potentially even more diverse in scope.

jonnybgood 9y ago

There are some decent intro books for adults out there if you don’t care about the branch. Honestly, if you’re looking for intro math books you really shouldn’t care too much about the branch. I think what’s more important is to develop mathematical thinking. Here’s some off the top of my head. I really think these will help you build a good foundation for mathematical thinking. Concrete Mathematics by Graham, Knuth, Patashnik Spivak’s Calculus How to Prove It by Velleman Polya’s How to Solve It E.T. Jaynes’ Probability Theory Conceptual Mathematics by Lawvere and Schanuel

bkcooper 9y ago
Concrete Mathematics Spivak Jaynes All good books, all pitched at a level that is very ill suited for what is being asked for. To the GP, "math for English majors" is a common enough course schema that I think looking at a few syllabi might score you something.
- jonnybgood 9y ago
  I specifically mentioned those because they have little to no prerequisites other than high school math which I interpret can be read by any non-math major. They’re very self-contained but have very little hand-holding. I think just absorbing a little of these books will establish a decent foundation.
  - jacobolus 9y ago
    Concrete Mathematics is pitched at graduate students in computing. Spivak’s Calculus is an introductory real analysis book pitched at undergraduates who have gone through a computational calculus course already and want to study the subject more formally and rigorously; it has many difficult problems and would generally benefit greatly from the structure and expert feedback of a university course. Jaynes’s book is probably most relevant to science students who are at least at the advanced undergraduate level. How to Solve It is a dictionary of heuristic problem-solving techniques which is most useful to someone who is already (deeply) familiar with mathematical problem solving, and wants to codify their existing methods. Even advanced undergraduate math students who read it aren’t going to fully understand the book IMO; I would recommend Pólya’s other books (Mathematics and Plausible Reasoning, Mathematical Discovery), or maybe start with a gentler book like Mason, Burton, & Stacey, Mathematical Thinking.

SpaceManNabs 9y ago

I felt the same. It is a decent enough refresher though! Machine learning lends itself to easily learning additional pieces of math once you have a nice foundation, and it is nice enough that the foundation is pretty small---vector calc, (mostly) real analysis, linear algebra (it helps if you know infinite but orthogonal eigenfunctions), little bit of physics knowledge (statistical models and hamiltonians), and a little bit of differential geometry. Unfortunately, that foundation is slowly getting bigger. Read some papers in topological data analysis recently. Category theory is crawling in!

atomicnumber1 9y ago

Ok, I don't know about book but 3blue1brown on youtube has some really cool videos on intermediate maths. He's videos are more about understanding the underlying concepts rather than formulas. https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw/playlists https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw/pla...

gtani 9y ago

The target audience would be people that have roughly 2 years of undergrad math, the 4 semester calc sequence or high school equivalent, probability/stats, linear algebra, some computational courses using e.g. Numerical Analysis by Burden/Faires. If you look in Goodfellow et al's Deep Learning book, Murphy's Machine Learning text and others mentioned here (Learning from Data, Shalev-Shwartz/Ben-David) the prereq's are always some variation of above and I think you could do a lot of the above at U.S. community colleges, at least the CC's around me. Frankly, you'd have to do a bunch of self study beyond CC and there's no shortcut/royal road. So the key is self study, that's a discipline anyone that wants to do Data Science/machine learning for real needs

aje403 9y ago

There is no free lunch, sorry. Either work for it for years or don’t. Or wait for brain implants or something.

dfan 9y ago

It looks to me like it's pitched approximately at third-year undergraduates who have a couple of years of a college math background, and is meant to pull them up to a level where they can fluently work with the more advanced concepts used in machine learning. The route for someone with no (or very little) math background is a lot longer, and I don't think this book is trying to provide it. I think that one either has to 1) bite the bullet and learn a year or two of undergrad math first, which provides the necessary foundation for this stuff, then learn this for real; or 2) be content with understanding and using machine learning at a hand-wavy level (which I am not denigrating). It might be nice to have a "hand-wavy machine learning" book around (there are certainly enough blog posts of that sort), but this isn't trying to be it.

monotypical 9y ago
It seems to follow the 4th year/masters course of the same name taught by one of the authors (Dr Marc Deisenroth) at Imperial College London: http://www.imperial.ac.uk/computing/current-students/courses/496/ http://www.imperial.ac.uk/computing/current-students/courses... The course requires a 1st year linear algebra course and a 2nd year statistics course, which might explain why this book doesn't cover some of the basic concepts

deleted 9y ago

[deleted]

ivan_ah 9y ago

I have two book recommendations that seem like exactly what you're looking for. Both are written by me, so I'm totally biased. The NO BULLSHIT guide to MATH & PHYSICS is a 3-in-1 combo book that includes a high school math review, mechanics, and calculus. Preview: https://minireference.com/static/excerpts/noBSguide_v5_preview.pdf https://minireference.com/static/excerpts/noBSguide_v5_previ... The NO BULLSHIT guide to LINEAR ALGEBRA covers all the standard LA material, and also discusses lots of interesting applications (graphs, graphics, crypto, quantum computing). Preview: https://minireference.com/static/excerpts/noBSguide2LA_preview.pdf https://minireference.com/static/excerpts/noBSguide2LA_previ... I put a lot of effort into making them with an "easy ramp up" so anyone with basic math background can pick up. If you don't remember you high school math in details, you can still handle. You can buy print versions on amazons or ebook on gumroad. See website for links: https://minireference.com/ https://minireference.com/