4 ms·
for M-L, brush up on your basic* math, and jack up on the probability and statistics. an eetsy beetsy volume on numerical computing, just enough to understand m
by mahmud 18y ago
for M-L, brush up on your basic* math, and jack up on the probability and statistics. an eetsy beetsy volume on numerical computing, just enough to understand machine representation of numbers and enough to understand errors (and their propagation!) should be enough.
don't hesitate to read engineering texts. the first few chapters of various DSP texts should give you an idea of what to look for ("oh, so it's loops over real-valued vectors! cool!") but if you read EE texts, feel free to ignore complex variables (unless your earlier math text was good enough to introduce them as vectors of two components :-)
An interactive language, preferably Octave/Matlab should come handy.
None of this will make sense right now, but hints are supposed by like that ;-)
--
[Edit:
* basic as in naive set theory, ability to reconstruct and prove properties of Real numbers using Dedekin-cuts, basic proof techniques, sequences, series, limits, functions as sets, basic trigonometric functions, the derivative and the anti-derivative, and most importantly understanding the various type of integrals, specially the Reimann. touching "real analysis" from the standard and Non-Standard angles should be enough. All this could be done in 2-3 months with the right texts. This is the minimal you will need to understand things; the basic properties of the logarithms should come handy, specially converting between logarithms of different bases (you will be working on bases 10 and 2, while the natural number is more prominent in engineering than CS.)
]
- plinkplonk 18y agoI would add Linear Algebra to mahmud's (great) list of mathematical "stuff to learn". A lot of ML needs Linear Algebra . (e.g Neural Networks, SVMs .. )
- deleted 17y ago[deleted]
- mahmud 17y agoThanks for taking over the thread for me plinkplonk. I posted a dense teaser and went to bed, then work for the rest of the day. You pretty much answered all subsequent questions the way I would have :-) Let me add that beginners couldn't go wrong with mathematics texts by Serge Lang, first-rate mathematician and master teacher.
- silentbicycle 17y agoAny particular math texts you'd care to recommend? I haven't studied math as a student in a while, though I've been doing a topical review via Project Euler.
- plinkplonk 17y ago"Any particular math texts you'd care to recommend?" I know you asked the question to Mahmud, but here is what I think. To start with, Undergrad texts (the best I've found) to prepare you for Machine Learning. Calculus (Strang) available free http://ocw.mit.edu/ans7870/resources/Strang/strangtext.htm http://ocw.mit.edu/ans7870/resources/Strang/strangtext.htm Linear Algebra(Strang) not free. Probability( by Bertsekas a new edition just came out. expensive but VERY good). Information Theory (also useful in ML) David McKay. freely available at http://www.inference.phy.cam.ac.uk/mackay/itprnn/book.html http://www.inference.phy.cam.ac.uk/mackay/itprnn/book.html Convex Optimizaton by Boyd. (free http://www.stanford.edu/~boyd/cvxbook/ http://www.stanford.edu/~boyd/cvxbook/). Videos available on the Stanford site. http://see.stanford.edu/see/courses.aspx http://see.stanford.edu/see/courses.aspx Plenty of books at the graduate level - Spivak's Calculus and Rudin's Introduction to Functional Analysis should get you most of the way through mahmud's list of things to learn After all these, you should be able to pick and choose for yourself. Enjoy!
- silentbicycle 17y agoThanks!
- Radix 17y agoSpivak's grad level? I hear he's taught to honors freshman at UT. He certainly is more difficult than a text by an unknown author.
- plinkplonk 17y ago"Spivak's grad level?" I hear what you are saying. By "grad level" I only meant that you need to be very comfortable with doing proofs to make any progress. Clumsy phrasing on my part. I am completely self taught in mathematics (and computer science).I have no real idea what is undergrad level and what is grad level in a real university. It took me a good long while before I tackled Spivak :-D. Apologies for any confusion caused!