9 ms·
Machine Learning in a Year
- mrborgen 10y agoHey, I'm the author of this article. Happy to answer questions if anybody have any.
- ingve 10y ago> "It’s possible to get a good machine learning teacher for around 50 USD per hour" How/where did you find a teacher like this? Finding a machine learning subject expert is already pretty difficult; knowing how to find one who is also a good teacher would be a useful skill in its own right.
- mrborgen 10y agoSure, I asked at Reddit/r/machinelearning: https://www.reddit.com/r/MachineLearning/comments/4kcrqp/looking_for_a_machine_learning_teachermentor/ https://www.reddit.com/r/MachineLearning/comments/4kcrqp/loo... A couple of people contacted me, and the first one I gave a shot was actually a perfect fit. Maybe I was a bit lucky right there.
- PunchTornado 10y agoThe article is helpful for all of us who are struggling with ML. Since your story is a success, no matter how you personally feel about it, can you tell us how many hours per week in that year did you dedicate your time to ML? A rough estimate will be good. What are your plans for future? Find a ML-only job?
- mrborgen 10y agoHmm.. hard to say, but in 2016 I've probably spent around 5 hours per week on average. Most of the times I've struggled with ML has been related to the fact that I've been trying courses/tasks that have been above my level. Once I find content which is tailored to my level, ML isn't that hard after all. I definitely want to do more ML in the future, one way or the other.
- FLUX-YOU 10y agoI'm testing my knowledge a bit, but this looks like it has 2-3 layers? One input, one hidden, and one output? (nn.py) When might you add additional layers to this particular problem? Would turning the results into a probability be useful? (e.g. "how likely are we to get a customer based on this description?") Your staff could generate test data for that. Thanks, great article!
- mrborgen 10y agoThat neural network is just an experiment I did the other day, and it doesn't work properly. I'm going to fix it when I have time. Regarding the results: I don't know how they'll be, that's why I'm experimenting with it ;)
- deleted 10y ago[deleted]
- Avalaxy 10y agoThe part about the Coursera course's steep learning curve feels so familiar. I'm doing the course as well, but it's pretty tough for me. I suck at maths and I don't know Octave or Python. It's a very good course though, I still try to watch some lessons every week, but I'm way behind schedule. I'm impressed by the author's ability to recognize his own failure in completing a course, because for me it often just keeps dragging on while I still think "some day I will finish it". I can't accept the fact that I just failed it. Sometimes I wish I was still in university, being able to dedicate 40 hours per week to just learning this kind of stuff and having teachers around.
- jules 10y agoIt is very hard to complete a course without having the prerequisites. If you took some courses in math and Python you would probably be able to pass it with much more ease.
- truth_sentinell 10y agoWhere can I take a math course for the laymen?
- rz2k 10y ago"Linear Algebra from Foundations to Frontiers" on EdX[1] is an introductory course in linear algebra with a manageable learning curve. There are many calculus courses on Coursera and EdX. [1] https://www.edx.org/course/linear-algebra-foundations-frontiers-utaustinx-ut-5-04x https://www.edx.org/course/linear-algebra-foundations-fronti...
- nvkris11 10y agoKhan Academy
- osoba 10y agoFor Calculus check Coursera - the Ohio State course if you really don't know absolutelly anything, then do the Penn State course(s) Calculus in a Single Variable For Linear Algebra check Gilbert Strang's course on MIT OCW For Probability/Statistics either John Tsitsiklis' course on MIT OCW (or even better on edX when it re-runs) or Harvard's Statistics 110: Probability course on youtube The level of multivar calculus you'll need is really minimal, just google these terms "partial derivative", "total derivative", "differentials and integrals commute" ("Symmetry of second derivatives", "Fubini's theorem") or take the vector calculus course from MIT OCW
- deleted 10y ago[deleted]
- caub 10y agoCoursera ML course wasn't particularly hard
- Nimitz14 10y agoI'm guessing the author hasn't a maths education beyond high school.
- mrborgen 10y agoI have a bachelors degree in economics, so some university math with calculus and linear algebra. The reason I found it hard was because I had to learn Octave while also understanding the algorithms and general ml concepts. That being said, I think it's a great course, and would highly recommend it to anyone who thinks they're up for it. But there are other courses that provides an easier gateway into ML.
- truth_sentinell 10y agoLike which one?
- sndean 10y ago> The reason I found it hard was because I had to learn Octave while also understanding the algorithms and general ml concepts. I had the same experience, even after using Matlab some in grad school. I wish I had seen this before trying Ng's course (all of the exercises in Python): http://www.johnwittenauer.net/machine-learning-exercises-in-python-part-1/ http://www.johnwittenauer.net/machine-learning-exercises-in-... So much quicker / easier to follow, at least for me.
- mtrn 10y agoMachine learning is an interesting case, in that the gap between theory and praxis is quite wide. You can basically create, run and evaluate a model within 10 minutes (e.g. with scikit-learn or Tensorflow). It would even be an acceptable model that might solve your company's problem. But you have to plan in a few years of deliberate practice to work through statistical learning theory and its prerequisites to get an overview and to be able contribute to the scientific or open source efforts in that field.
- llasram 10y agoAnd in my experience the opposite applies as well. Having a PhD in a field providing the necessary background in theory doesn't necessarily imply the skills and experience required to produce useful models.
- mtrn 10y agoIn your experience, what personal characteristics, educational background or personal trait did successful individuals have?
- llasram 10y agoThat's a really good question. The best people I've seen so far have had a willingness to rigorously align their models with reality, plus the knowledge and/or experience to know what to check. Verifying assumptions, picking evaluation metrics appropriate for the problem, checking for model interpretability, checking that model decisions are sane, and so on.
- reader5000 10y agoThe theory isn't there, at least not for multilayer NNs.
- Eridrus 10y agoI disagree wrt contributing to open source. There's still a lot of general software engineering that goes into these systems. I've found d it pretty easy to contribute implementations since the core of many ideas are actually quite simple. Of course they're only simple in hindsight, but implementation is just that.
- K0nserv 10y agoI've been doing the Coursera ML course the past few weeks(started on the 22th of August). I can only give it my highest recommendation, it really is a great course. I did computer science in university(2.5 years) and have a decent grasp of calculus and linear algebra. I've also been programming for 9 or so years. I've found the course to be surprisingly simple and intuitive, but this probably varies with how comfortable you are with the math in the course.
- albertojacini 10y agoI completely agree. It was also very well balanced between theory and practice.
- wrcwill 10y agoIs it the UofW course or Andrew ng's?
- K0nserv 10y agoAndrew ng's
- mamon 10y agoI'm also doing this course right now. Having MSc degree in computer science helps a lot, although I got my diploma as long as 10 years ago, but still some math sticked with me. My biggest regret is that my day job as developer does not leave me with much time for more Octave programming. Of course I do excercises, but that's not enough to be good ML developer. However, I think that just having a lot of sample code would be helpfull if I ever make ML my full time job. Especially considering that the excercises themselves are pretty interesting (handwriting recognition, image compression, etc).
- noname123 10y ago>Coursera ML course the past few weeks(started on the 22th of August). I can only give it my highest recommendation. I'm taking the edX series of courses on Machine Learning with Apache Spark. It is a pretty good class and covers linear algebra and the basic ETL workflow, plus selection of models, model parameters tweaking parameters etc., study cases involving user ad clicks prediction and PCA analysis of neural synapse data of jellyfishes. However, my biggest fear is that re-learning different matrix manipulations, walk-through of logistics regression, PCA and SVM will be similar to learning Spanish in high school without immersion, learning guitar scales without improvising with it, learning mappings of different Madden key-combo's; I remember learning all of these mathematical syntactical operations in high school, and have an eerie feeling of once grasping these concepts concretely once and yet only knowing it vaguely. It is nice to re-learn these things, like refreshing myself with a rolodex of Spanish verb conjugation, only to go back to the CRUD work I deal with on a daily basis and fade back to oblivion. Not sure about the Coursera class, the structure of the edX courses are presented in Python Juypter notebooks where you fill in the code snippets. It is fun and addictive to solve each exercise as a mini-puzzle; but not sure how much it'll stick vs. if one had to take an concrete problem and take its pieces and puzzles from start to finish, without the hands-holding. I think perhaps Cousera courses have "capstone" projects - curious if anyone have had experience doing one? In lieu of one on the edX course, I think I plan to grok some papers with some large genomic dataset and/or financial time-series and try to replicate their result.
- Cozumel 10y agoThe title makes a refreshing change from 'in 24 hours'!
- cooper12 10y agoYou might like this: http://norvig.com/21-days.html http://norvig.com/21-days.html
- adamnemecek 10y ago/r/machinelearning had a cool list of advanced courses the other day https://www.reddit.com/r/MachineLearning/comments/51qhc8/phdlevel_courses/ https://www.reddit.com/r/MachineLearning/comments/51qhc8/phd...
- voiceclonr 10y agogood one!
- stable-point 10y agoI've attempted to do Coursera's ML course, but I am not very good at learning from videos - I much prefer reading a text book and then attempting the problems in my own time. Are there any recommended text books that one can read from start to finish in order to get a similar introduction to ML?
- iandanforth 10y agoFor the deep learning segment of ML I can recommend the still-being-written text https://www.manning.com/books/grokking-deep-learning https://www.manning.com/books/grokking-deep-learning. Very low math requirement, exercises in Python.
- Notre1 10y agoI think a good book that is closer to Andrew NG's course would be the An Introduction to Statistical Learning (ISL)[1] Depending on your learning style, Data Science from Scratch[2] might be another good option. BTW, neither of these uses Octave like Andrew NG's course does. The first one uses R and the second uses Python. [1]: http://www-bcf.usc.edu/~gareth/ISL/ http://www-bcf.usc.edu/~gareth/ISL/ [2]: http://joelgrus.com/2015/04/26/data-science-from-scratch-first-principles-with-python/ http://joelgrus.com/2015/04/26/data-science-from-scratch-fir...
- steven_pack 10y agoThere was a great ML presentation at RustConf yesterday where a couple of guys broke down building a classifier using Python and Rust. It really demystified the process.
- francogt 10y agoI see everyone talking about Andrew Ng's ML course and having some difficulty with octave. Why is no one trying the new ML with Python series by UW on Coursera? It seems pretty well structured.
- K0nserv 10y agoHonestly Octave/Matlab isn't a problem I've found. If you are vaguely familiar with any programming languages it shouldn't be a problem. To me Matlab is just another tool to express my thoughts just like any other programming language. Sure it as has some things to learn, but it's not like it's a whole new paradigm or anything. Personally I struggled more with getting the linear algebra right than the syntax of Matlab
- morgante 10y agoHere's a different question: is it worth it? I know enough about machine learning (and scikit-learn) to make simple models with production deployments. The results are pretty good, but they come almost exclusively through trial and error—testing different algorithms and approaches until something works. Unfortunately, I really don't understand the underlying theory. Every time I start diving into it, I realize it'll probably take a huge amount of time to understand (particularly because I'll likely have to do an intensive refresher on linear algebra and multivariable calculus). How dangerous is it to be practicing machine learning without deeply understanding the theory? Is it worth the substantial time investment?
- giardini 10y agomorgante: "Here's a different question: is it worth it?" Only you can be the judge of that. A better question is "What is the opportunity cost?". Is there something else that one could do with that same time that would be more valuable/useful? I suspect that most persons have a number of things that would be more valuable to them than learning ML to some vague degree and undefined purpose. One might take an economics course, exercise more and pay more attention to one's diet to get into better shape, get more sleep, sell the boat, read Nicholas Taleb's second and third books, etc.
- giardini 10y agoI just stumbled onto this: "Data Scientists Automated and Unemployed by 2025?" http://www.kdnuggets.com/2015/05/data-scientists-automated-2025.html http://www.kdnuggets.com/2015/05/data-scientists-automated-2... Nothing to get excited about, especially since you aren't yet invested. However, should the odds indeed be high that ML will become automated by 2025 then another field choice might be wiser.
- Houshalter 10y agoFWIW you can learn how these algorithms work without a very deep understanding of calculus or linear algebra. I did it, although I'm trying to catch up on the math now. And really for the average ML user, you don't need to learn the exact math or calculations, just a general understanding of what it's doing. Above all have a good understanding of over fitting and best practices for test and validation sets. Then you can use algorithms as black boxes and at least know you aren't doing any harm.
- criddell 10y agoI love the idea of using data to train a machine to recognize patterns and classify things. It's kind of a bummer though that the application is to help sales people do their job.
- baristaGeek 10y agoCan anyone tell us how hands-on is Stanford's CS224D please? I found Andrew Ng's course too theoretical and not so practical. Right now I'm almost halfway through Udacity's Intro to Data Science and it's great, so I'm deciding if I should take Udacity's Deep Learning or CS224D