13 ms·
Looking through the topics covered, the standard AI-course caveats (https://news.ycombinator.com/item?id=16247629 https://news.ycombinator.com/item?id=16247629)
by minimaxir 9y ago
Looking through the topics covered, the standard AI-course caveats (https://news.ycombinator.com/item?id=16247629 https://news.ycombinator.com/item?id=16247629) apply.
Yes, AI/ML MOOCs teach the corresponding tools well, and the creation of new tools like Keras make the field much more accessible. The obsolete gatekeeping by the AI/ML elites who say "you can't use AI/ML unless you have a PhD/5 years research experience" is one of the things I really hate about the industry.
However, contrary to the thought pieces that tend to pop up, taking and passing a crash course doesn't mean you'll be an expert in the field (and this applies for most MOOCs, honestly). They're very good for learning an overview of the technology, but nothing beats applying the tools on a real-world, noisy dataset, and solving the inevitable little problems that crop up during the process.
Reviewing the Keras documentation (https://keras.io https://keras.io) and examples (https://github.com/keras-team/keras/tree/master/examples https://github.com/keras-team/keras/tree/master/examples) are honestly much better teachers of AI/ML than any MOOC, in my opinion.
(Of course, Keras is now a part of TensorFlow, so there's a neat Google vertical intergration with this crash course!)
- ariwilson 9y agoIsn't this meant to be an introduction? I'm not sure who comes out of a crash course assuming they're an expert.
- jorgemf 9y ago> "you can't use AI/ML unless you have a PhD/5 years research experience" This is not true since a few years ago. But the fact that you can use it doesn't mean you understand what is happening and why it works in development but not in production. Everybody can copy a jupyter notebook and train a TensorFlow model in ImageNet. Now go to a new domain with very few information like 3D models and create a new network to be trained in that dataset. How many people that can train ImageNet can do the latter? Even inside deep learning experts in image classification fail in reinforcement learning domains and need a couple of years to be completely productive.
- acconrad 9y ago> The obsolete gatekeeping by the AI/ML elites who say "you can't use AI/ML unless you have a PhD/5 years research experience" is one of the things I really hate about the industry. So what are they hoping to achieve with this course? I'm genuinely asking because part of me wants to take the course, but another part of me feels like what's the point if, even through many additional courses to build up a skill set, Google wouldn't hire you as an ML engineer unless you basically start your career back to a junior engineer but in machine learning at another company.
- pilooch 9y agoNo but you'll ready yourself for the (geometric) programming of the next twenty years or so.
- solarkraft 9y agoI have a feeling that they're trying to get people familiar with TensorFlow and thus very compatible with their cloud computing services.
- eanzenberg 9y agoI dunno.. for this level of ml scikit/numpy is way more accessible than tensorflow.
- mdda 9y agoLook at it from an interview perspective. If I ask "are you interested in exploring ML", and you're enthusiastic, my next questions are : What have you done? Have you taken any courses? GitHub? Blog Posts? If the answer is that you're waiting for a special sign that it's worth doing before making an effort, then that really tells me that your enthusiasm for doing ML is not reality-based. Doing the ML thing is a pretty different mindset from other software jobs.
- 3pt14159 9y agoUnless you work for a company obviously known for their ML the "expertise" out there right now is brutal. People are building recommendation engines without knowing the very, very, very basics like Jaccard indexes, ROC Curves, or topic drift. I've even had to explain type two error to someone working on one of these before. I agree with your general thrust, and you're right, messy data is often 95% of the problem, but even going through just the Google courses will put people in the top 15% in most cities.
- fwdpropaganda 9y agoWhat's topic drift?
- stochastic_monk 9y agoIt seems to be a specialized term referring to the change in focus of blogs [0] and online communities [1] over time. This strikes me as a very specialized concept, rather than a generally-important term in machine learning as a whole. Edit: To add my perspective, with years of industry experience and graduate-level machine learning coursework, I have never before encountered this term. [0]: https://link.springer.com/chapter/10.1007/978-3-319-16354-3_52 https://link.springer.com/chapter/10.1007/978-3-319-16354-3_... [1]: http://catb.org/jargon/html/T/topic-drift.html http://catb.org/jargon/html/T/topic-drift.html
- epsilon_machine 9y agoAlso seems closely related to the concept of stationarity in time series analysis [https://en.wikipedia.org/wiki/Stationary_process https://en.wikipedia.org/wiki/Stationary_process]
- ju-st 9y agomaybe he meant concept drift? https://en.wikipedia.org/wiki/Concept_drift https://en.wikipedia.org/wiki/Concept_drift
- 9y ago
- foobiekr 9y agoGate keeping is only obsolete when it ceases to have impact. The reality right now is that ML is extremely hard to enter even for a very knowledgeable and deeply experienced but non-credentialed (by degree) person. It will be interesting to see how the situation evolves but my own observations are that people trying to enter the space might be better off getting a quickie masters if they can afford the time or cost than to try and bootstrap it.
- eanzenberg 9y agoEven people getting a quickie masters is hit/miss in my experience. At the end of the day, successful machine learning engineers require a whole suit of different skills, both technical, communicative, and even life skills that don't really exist for software devs. Not all those can be taught in 3 months, 2 years or even 6 years.
- ariwilson 9y agoLife skills? Communicative skills? What?
- eanzenberg 9y agoIMO essentially ML experts don't work in a bubble and may interface with potentially anyone at a company; C-level, engineering, product, marketing, ops, etc etc. What other tech-employee needs that flexibility? So, I grouped communication / life skills into being able to understand, read, interpret and ultimately provide value to potentially any team. Just having the technical skills will only get you so far.
- icc97 9y agoI fully agree with you that after a MOOC you've barely scratched the surface and until you're implementing them yourself then you're not going to jump into a ML job. However personally I view the rest of the opposite way round. Getting through a course on Deep Learning takes months [0]. Then reading through Keras code once you understand the appropriate NNs is easy. For example it takes a while of going through Neural Networks to understand ResNets. But if you understand ResNets then looking though Keras code that creates a ResNet [1] is easy. If I want to build a NN of any sort in Keras I can just Google for it. However there's no simple Googling you can do to teach yourself NN in an easy to follow structured way. [0]: https://www.deeplearning.ai/ https://www.deeplearning.ai/ [1]: https://github.com/Hyperparticle/one-pixel-attack-keras/blob/master/networks/resnet.py https://github.com/Hyperparticle/one-pixel-attack-keras/blob...
- p1esk 9y agoUnderstanding NNs is easy. Understanding, collecting, and cleaning up data is the hard part. Also, DL != ML. Paraphrasing "The Tao of Network Protocols": If all you see is DL, you see nothing.
- icc97 9y agoThe parent was referring to Keras which is a NN API hence why I responded talking about NN.
- tonypace 9y agoThere are a tremendous number of people outside of programming who spend much or all of their work time collecting, cleaning up, and understanding data. Think teachers, accountants, traders - essentially everyone who spends a lot of time in spreadsheets.
- cowmoo728 9y agoWe have to separate AI researcher and implementation engineer. These types of crash courses help get you to the point where you can reasonably work under PhD level people and write code to test, scale, and deploy their ideas. For many current applications of ML this is acceptable because you're just stealing an idea from a paper or stealing ImageNet to recognize your problem. For anything else you really need to pay up and fight with Google for a real expert.
- akmiller 9y agoExactly. Somewhat akin to graphics programming. There are much smaller groups that work on actually building 3D graphics engines, however, many developers take those engines and use them to build successful applications and games.
- stealthcat 9y agoSo we need to wait for Unity of ML? With Asset Store selling models and datasets.
- maxxxxx 9y agoWill we reach a state where ML is as accessible for implementers as SQL databases? I still remember the time when databases were only for experts.
- infinite8s 9y agoYes hopefully. Take a look at BayesDB (and the underlying crosscat algorithm) and probabilistic programming.
- aje403 9y agoThey really don't. There is a link to the Wikipedia page for matrix multiplication. If these are the people you want to hire, you might as well start outsourcing or generating random numbers
- deviationblue 9y ago
- Florin_Andrei 9y agoTLDR: Taking a class is fine, but nothing beats real-world practice. Wonder where I've heard this one before. :)
- achompas 9y ago> The obsolete gatekeeping by the AI/ML elites who say "you can't use AI/ML unless you have a PhD/5 years research experience" is one of the things I really hate about the industry. It is absolutely true that you do not need a graduate degree to apply AI/ML to vanilla problems. It is also absolutely true, in my experience, that you need a graduate-level education or years of hands-on experience to troubleshoot cases where AI/ML fails on a deceptively-simple problem, or to tweak an AI/ML algorithm (or develop a new one) so it can solve a novel problem. That said, I think these MOOCs are good enough to get someone to a place where they can create nice /r/dataisbeautiful-style visualizations, or pair with a senior-level DS to deliver something. (Edited to add folks who have worked on problems for years and add a final note.)
- bluetwo 9y agoI can't help but think in 3-5 years how quaint our tools of the day will seem.
- achompas 9y agoI think about this constantly. Not to sound like I walked uphill in both directions back in my day or something, but I remember building models in numpy without pandas. It was tedious -- and that's just a nice API wrapping ndarrays!
- bhrgunatha 9y ago> Not to sound like I walked uphill in both directions back in my day Local minima?
- YeGoblynQueenne 9y agoMost likely, gradient descent with momentum.
- farazbabar 9y agoOh boy, that and perturbation.
- xamuel 9y agoThe other day I met with someone who was visiting my city to attend a big ML conference. In the course of our discussion, it transpired this person did not know the Halting Problem. He'd "heard of" Turing machines, but nothing more than "hearing" of them. Gatekeepers shouldn't keep gates just for gatekeeping sake. But if so-called ML experts don't even know undergraduate computer science, that should really give you pause before you open up your wallet for them.
- eanzenberg 9y agoWhy? Most of that cruft is abstracted away, computation only gets cheaper over time (a world class AI rig cost ~30k, a decent one for 2k) and most applications of ML run on commodity hardware.
- xamuel 9y agoFor one thing, it suggests that they are actually technicians, not the scientists they're selling themselves as. That's fine if you want a technician (and if they're charging technician's rates).
- eanzenberg 9y agoAnd then that technician rate is X times what a technician rate would be for pure software dev.. what is your point?
- opencl 9y agoI think when it comes to ML the CS experts with limited statistics knowledge are the technicians and the statistics experts with limited CS knowledge are the scientists, not the other way around.
- grad_ml 9y ago"turing machines" are cs 101?
- xamuel 9y ago
- ssivark 9y ago> Yes, AI/ML MOOCs teach the corresponding tools well, and the creation of new tools like Keras make the field much more accessible. The obsolete gatekeeping by the AI/ML elites who say "you can't use AI/ML unless you have a PhD/5 years research experience" is one of the things I really hate about the industry. The problem is that having a hammer makes one see everything as a nail. Sure, given a suitably clean set of images, anyone who's done a couple of tutorials will be able to apply a pre-trained neural on them to get something. The hard part is getting an understanding of what tweaks to use when, and when to give up on a method. Otherwise, it is very easy to get carried away and waste time/resources. For that, one needs to develop a good understanding of the landscape of ML algorithms, why each of them works and how they could break. That typically takes (intensive) experience or an understanding of the theory. Otherwise you'll be doing a brute-force search through a list of possible algorithms. As they say, "a few days in the lab might save a few hours in the library..." Yes, things can get painful during hiring because the process is broken as it is, with additional complications due to not knowing how to vet for quality in a nascent field. But the "ML elite" are not morons and they don't mean to be obnoxious gatekeepers.
- Puer 9y agoThe real barrier to entry to ML is statistics. Most computer science degrees require an intro to statistics class, but if you really want to understand ML and where it should and can be applied appropriately you need a much deeper understanding. IMO, it's much easier to pick up the programming required for ML than the statistics. This was reflected in the classes I took as a double statistics/computer science major. Most of the people in my CS department's machine learning course were statistics students looking to go into data science, not computer programmers looking to get in on the ML trend.
- taneq 9y ago> taking and passing a crash course doesn't mean you'll be an expert in the field (and this applies for most MOOCs, honestly) Any field that you can become an expert in with a 6-week course or less is not a field that should be paying even high 5-figure salaries. Or, conversely, any field which pays 6-figure salaries is either not accessible via an MOOC, or is massively overinflated and probably in a bubble.
- deleted 9y ago[deleted]
- balls187 9y ago> taking and passing a crash course doesn't mean you'll be an expert in the field (and this applies for most MOOCs, honestly) You're stating the painfully obvious here. I doubt anyone reading HN is under the impression that they'll be an expert after a single online course. This is just a marketing stunt by Google to ensure their tooling is the defacto standard for AI/ML so that Google can dominate the AI/ML market they way they dominated Internet Search.
- andreagrandi 9y ago> The obsolete gatekeeping by the AI/ML elites who say "you can't use AI/ML unless you have a PhD/5 years research experience" is one of the things I really hate about the industry. It's the main reason why I decided to present a talk at the next PyCon Italy, as a very junior data scientist, to inspire other Python developers to learn some practical machine learning. If I could do it (and use it for a work project already) many other people can do (and no, I don't even have a degree in CS, just years of work experience)
- YeGoblynQueenne 9y ago>> The obsolete gatekeeping by the AI/ML elites who say "you can't use AI/ML unless you have a PhD/5 years research experience" is one of the things I really hate about the industry. I'm going to have to ask who exactly are those AI/ML elites who say "you can't use AI/ML unless you have a PhD/5 years research experience".