8 ms·
6.S094: Deep Learning for Self-Driving Cars
- buckhx 10y agoIt looks like they'll be posting the lectures online which is pretty rad. I'll be sure to make some time to watch these.
- shoshin23 10y agosuper cool to see this here. do the lecture videos go up the same day as the lectures?
- tancik 10y agoThey should be posted within a few days of the lecture.
- zerr 10y agoI wonder how it compares to Udacity's similar course.
- deepnotderp 10y agoIMO, the udacity SDC course is pretty bad.
- deleted 10y ago[deleted]
- kyle_martin1 10y agoI just enrolled in the Udacity SDC nanodegree. Can you elaborate?
- bitL 10y agoIt's pretty cool, you'll have fun! It's "practical" not "theoretical", so the focus is on getting code working and understanding bare minimum of math you need.
- kyle_martin1 10y agoSounds pretty similar to Udacity's AI for Robots course! Good to know that they focus on intuition rather than rigor. Many professor enjoy stroking their ego with rigorous math, rather than communicating higher-level ideas and making their subject seem "easy".
- bitL 10y agoAI for Robotics is a way way simpler course than SDC ;-) In SDC you actually get to train CNN to classify traffic signs from the scratch, to make a car in a racing game learn to drive similarly to your style and to detect real-world road features properly as you are driving. It made me smile very often when I saw how simple they made it appear :)
- kyle_martin1 10y agoOf course haha! I was remarking on the breadth by which they explore and prove the underlying math.
- windsignaling 10y agoThat perspective seems a little naive. They are professionals, so they know "what it takes" to be good at the subject. Machine learning math is not rigorous in comparison to the type of math you'd study as a math or physics major. Machine learning math is useful precisely because of the fact that it shows you intuitively how the concepts work. Knowing the "high level" ideas is near-useless. I can get the "high level" ideas of quantum mechanics from any high school or pop science physics book. Does that mean I know quantum mechanics? Only at an extremely superficial level. And I suspect anyone taking a MOOC on AI or machine learning wants to end up with more than superficial knowledge.
- kyle_martin1 10y agoSorry I wasn't clear about "high level". I was mostly speaking about math professors in college. I have degrees in Math and EE...advance math isn't an issue. Having abstract intuition (aka "high level ideas") in math is incredibly value. Sometimes things get hairy in the computation and you need to step back and consider the bigger picture again. If you don't understand how the math works then you don't have the intuition and vice-vera.
- cr0sh 10y ago@bitL's comment of it being "practical, not theoretical" is pretty spot-on. I'm currently enrolled in and taking the course; I've also taken Udacity's CS373 course (when it was first offered in 2012) - and early courses that formed the foundation of Udacity and Coursera (ie - the Stanford-sponsored AI Class and ML Class, respectively). Again - what I noted in another comment - if you aren't comfortable with coding (Python and C/C++ in the nanodegree course), or linear algebra - you might have a tough time. You'll also likely want to brush-up on your stats/probability knowledge (though this hasn't come up yet - not like the CS373 course, or the AI and ML Classes). Finally, while you won't absolutely (well - not that I've seen yet) need super-detailed knowledge of what a derivative is or how it is derived (?) - that bit of Calculus seems to be important in machine learning (it is something I struggle with). Ultimately, give it a shot and have some fun; so far, I have enjoyed everything (just finished the lesson and lab for the Keras framework last night). Don't get too hung-up on the "due dates" for projects; ultimately the main due-date is the end of the term (you have to have everything completed by then to not have to retake the term). Be sure to use the forums, your mentor, the Slack channels, and the facebook page to get help and inspiration. Oh - and you are able to publish your solutions and code around, but if you decide or need to use code provided by someone else (or you use someone else's solution, or ideas from a paper, etc) - YOU NEED TO DOCUMENT THIS in the project rubric (otherwise it will be considered plagiarism which, if found out, may get you kicked from the course) - so be sure to credit your sources! Finally - if you enjoy the course - be sure to check out Udacity's CS373 course, their "Intro to Artificial Intelligence" course (both of those I believe are free?), and Coursera's Machine Learning course (also free). There are also a ton of other great online resources and books out there; let me know if you need or want suggestions!
- deepnotderp 10y agoOn mobile so this won't be thorough, but compare the udacity course to the free (!) Coursera course from Andrew ng and you'll see the difference. I'm not even talking about mathematical rigor, I myself prioritize intuition over symbolic rigor, but you need to have the intuition of what's going on, not treat keras like a black box that magically spits out a ConvNet. Another thing I dislike is the lack of real world production deployment work. In an engineering oriented course, this should be the top focus. Unfortunately, this isn't really the case. That being said, I would say it's better than many universities.
- cr0sh 10y agoHow so? And are you talking about CS373 or the Nanodegree course? Mind you, I'm kinda biased as I have taken the CS373 course, and I am currently enrolled in and taking the Nanodegree course. But I am willing to be objective about it. I can honestly say that in both, I have learned some useful things. What I have learned I believe I can build upon myself to explore new areas (for myself - maybe not in the general sense). Are the courses perfect? No. Both skim rapidly over the material - which can leave you wondering and questioning things. In many cases (labs and projects especially) you need to rely upon asking questions of others - your peers or mentors - in the forums and other outlets (I particularly like the Slack channels in the Nanodegree for this). There's more than a bit of "reading in between the lines" and needing to reference notes and prior code implemented. But that should be expected. I think both rather expect you to already have a good handle on coding, as well as experience or exposure to linear algebra, stats/probabilities, and some calculus (primarily what a derivative is and how to get one); those last two are sticking points for me (especially the latter - prior courses have at least given me a better grasp and intuition about probability - but I am not an expert at it). If you don't have those pre-reqs, you're going to have a tough time at progressing meaningfully thru the courses. I also know that neither course is a substitute for anything like a uni-level CompSci degree, or courses for that, or electrical engineering, mechatronics, machine learning, etc. If you want that kind of rigorous treatment, you're going to need to buckle down and do it. But you know what? These courses (and a few other things I've read) are inspiring me to pursue a BS, then an MS in CompSci! Which I think is great, even if it's a "late-stage" thing for me to do (I'm 43 years old, and I never went to college - my higher-learning after high school was an "associates degree" from a private tech-oriented vocational school which I am pretty sure is worthless today; I've taken a couple community-college classes, too). I plan to do this all online (I don't have the time or money to do it any other way, unfortunately). Right now, I'm not sure how these Udacity courses will fit into things, but I'm using them as stepping stones to greater possible efforts. The worst case scenario is that I use what I have learned in my hobby of DIY robotics; I've spent more for less (for instance, a year-long membership to TechShop that I only visited about 3-4 times, because it was located so far away from my house). So - I guess I am curious about your views and why you think it is "pretty bad"?
- source99 10y agoI'm considering taking it as well. Any more feedback would be greatly appreciated?
- krashidov 10y agoReally? I've heard only good things. Why is it so bad?
- deleted 10y ago[deleted]
- joshsyn 10y agoIt irks me, that this site is not using HTTPS. And wants me to register using passwords
- marysimpson 10y agoWe are part of a team consisting of highly efficient developers and hackers. We Upgrade University Grades, Remove Criminal Records, Hack bank accounts as well as we are expert of various ecommerce management systems like verified paypal, Mastercard with untraceable credit on it etc. We do custom software and web development in php, java, asp.net etc. We also develop hacked facebook, twitter, instagram, yahoo, gmail passwords etc. We have 100% records from our client as well as highest repeat hire rate. our work speak for ourselves, we provide a perfect software solution to all clients. We believe in mutual growing with client and hence we work as a technology partner and consultant for our clients steelbreaker@techie.com or text 19283233115
- throwthrow222 10y agoWhich specific Coursera and/or Udacity courses are good for coming up to speed on the math/stats&probability knowledge needed for their SDC/AI/ML courses?
- SnowingXIV 10y agoI'm curious too, I'd like to know what prerequisites are needed for these lectures to make some sense and be beneficial.
- krastanov 10y agoA linear algebra course is the bare minimum (and frequently it can be enough). You can pick up any textbook and that would give you good enough preparation. After that you probably will have enough domain knowledge to choose what course to take next yourself.
- monocasa 10y agoIf I don't really remember what all was in my Linear Algebra class from 15 years ago, but have a working knowledge from graphics would that work, or would I need more of a theoretical background in linear algebra do you think?
- randcraw 10y agoI recommend Coursera's Coding the Matrix (linear algebra and a bit more) http://codingthematrix.com/ http://codingthematrix.com/ and https://cs.brown.edu/video/channels/coding-matrix-fall-2014/ https://cs.brown.edu/video/channels/coding-matrix-fall-2014/ And edX's Intro to Probability (MIT 6.041x) https://www.edx.org/course/introduction-probability-science-mitx-6-041x-2 https://www.edx.org/course/introduction-probability-science-... BTW, this course starts again on Jan 17. I don't know any good MOOC statistics courses. Most that I've seen have oversimplified the concepts into recipes.
- ramzyo 10y agoFor math/stats&probability in the specific problem domain of autonomous vehicles (of which self-driving cars are a subset) I'd recommend no other than Sebastian Thrun's Udacity course "Artificial Intelligence for Robotics" [https://www.udacity.com/course/artificial-intelligence-for-robotics--cs373 https://www.udacity.com/course/artificial-intelligence-for-r...]. The content is practical, and Thrun, in my opinion, is great at breaking down complicated topics (e.g. Kalman filters) into simpler sub-components and explaining the intuition behind them. You'll get a heavy dose of math/stats&probability in the context of autonomous robots (and in certain cases, Thrun contextualizes to his work in the DARPA grand challenges while at Stanford, which laid the groundwork for his work at Google on the self driving car project [now Waymo]). I can't speak to how much the "traditional" localization, mapping, and planning techniques taught in the course crossover to deep learning approaches, but you'll no doubt get the math/stats&probability knowledge you're looking for, in the context of self-driving cars.
- deleted 10y ago[deleted]
- hackernewsacct 10y agoWhat are good online sources for a beginner to learn calculus, linear algebra and stats/probability needed for machine learning? I don't want courses that teach math by coding but actual math courses. A lot of these online ML courses treat math as a black box so you never fully understand what's going on & a lot of math based ML courses are too advanced. So I'd rather focus on understanding the math basics before diving into ML. So what do you guys recommend?
- egdamy 10y agoWhy not a book instead like the elements of statistical learning? http://statweb.stanford.edu/~tibs/ElemStatLearn/download.html http://statweb.stanford.edu/~tibs/ElemStatLearn/download.htm...
- hackernewsacct 10y agoBased on Amazon reviews recommending this book to a beginner is like recommending rudin to a high school junior that wants to learn calculus for the first time. Is there a better book?
- smalley 10y agoIntroduction to Statistical Learning? It's free and has an available MOOC http://www-bcf.usc.edu/~gareth/ISL/ http://www-bcf.usc.edu/~gareth/ISL/
- hackernewsacct 10y agoThanks for the link. https://www.amazon.com/Elements-Statistical-Learning-Prediction-Statistics/dp/0387848576 https://www.amazon.com/Elements-Statistical-Learning-Predict... vs https://www.amazon.com/Introduction-Statistical-Learning-Applications-Statistics/dp/1461471370/ref=pd_sbs_14_img_0/154-7991761-3362320?_encoding=UTF8&psc=1&refRID=YG2KQEC1JWSP85B5P1K0 https://www.amazon.com/Introduction-Statistical-Learning-App... The former seems to assume prior knowledge and the latter seems more beginner friendly, except it uses R (in case anyone wants the distinction).
- randcraw 10y agoBTW, there's a well regarded new book on autonomous cars that looks like fun: 'Driverless: Intelligent Cars and the Road Ahead' by Lipson and Kurman. Lipson is a professor of robotics at Columbia. https://www.amazon.com/gp/product/0262035227/ref=oh_aui_detailpage_o07_s00?ie=UTF8&psc=1 https://www.amazon.com/gp/product/0262035227/ref=oh_aui_deta...
- Animats 10y agoTrying to do self-driving entirely by deep learning in a reactive system seems like a terrible idea. Deep learning to classify objects (bicycles, pedestrians, cars, traffic lights, telephone poles, cops) is fine. But map building, planning, and obstacle avoidance needs to be more reliable than a purely reactive system can do. Look at the videos from Urmson's talk at SXSW. That shows the worldview of a Google self-driving car. It's about 80% geometry and 20% classification. Yes, you can get a pure deep learning system to drive on a freeway. But how does it do in a more cluttered environment? A system that builds local maps and profiles terrain with LIDAR can deal with clutter.
- nojvek 10y agoTotally agree on this. Making neural networks build a debuggable scene graph is a pretty hard challenge. With the scene graph things become quite easy.
- tabeth 10y agoWhy exactly can't you use deep learning to drive in a "cluttered environment?" You didn't mention why it's a terrible idea (I have no background in deep learning, just curious)
- visarga 10y agoBoth model-based and model-free reinforcement learning methods are useful and sometimes are combined in an agent.
- gravypod 10y agoI was reading through the page on the Docker install [0] and after giving it a look I'm really interested in a docker GUI. I'd hate to have to type or memorize that for a class or for doing something useful and I'd also dislike needing to maintain a file with 50 different scripts to stop & start docker and what I want to run at any given time. Anyone know of something like that?