11 ms·
Baidu Hires Andrew Ng
- arctansusan 12y agoBy completely leaving Coursera, this is a vouch of confidence for MOOcs in general. sarcasm Horray for worthless online degrees that have an attrition rate past 90% of total registered students and a near-zero overall completion rate. I'm sure MOOCs will have a great future henceworth now that the CEO of a very visible MOOC company has left.
- towlesda 12y agoMOOCs are great for people who want to learn on their own (although no different than classes in college, some are more valuable than others). I'm not sure of the value these bring in getting a job, but the learning value makes them very worthwhile.
- bayesianhorse 12y agoMOOCs are even better for people who have to learn on their own. Which is almost anyone, most of the time. You usually don't have time or money for degrees in multiple fields, so most "continued learning" if not in very rigid programs, is essentially "learning on your own".
- visarga 12y ago> MOOCs are great for people who want to learn on their own MOOC + in person coaching could solve the problem. We don't need professors, we need coaches (experts in education, psychologists) to keep people motivated and not drop off. Also, in large cities study groups could generate the same feeling as going to a real class. What we are missing in MOOCs is the motivational effect of meeting people (in real life) who are serious about learning and seeing them work hard. That is what makes us believe we can do it too.
- bayesianhorse 12y agoThe "Mooc" movement is actually going as strong as ever. The goals of these courses is not to have high completion rates, but to give anyone a chance of learning as much as he wants. Sometimes though, moocs are held to standards and goals they never ever set themselves, like replacing universities, which none of them actually want.
- vijucat 12y agoThe attrition rate is due to the lack of cost involved in opting out if you find yourself unable to keep up with the course / too many courses. Being able to try and see if you can do a course (despite the other commitments in your life) is actually very attractive because most people cannot assess their goals or time budget that accurately. From the MOOCs' point of view, this is a worthwhile feature because while it does increase the false positive rate tremendously, it also increases the true positive rate : more people sign up for the course because the barrier to entry is low and end up completing it. Also, it does a wonderful job of introducing a new product to the market : I do not know a single friend in my circle who has not tried out Coursera. And guess what, I would happily pay up if they charge a reasonable fees in the future!
- chriskanan 12y agoA more detailed article by MIT Technology Review: http://www.technologyreview.com/news/527301/chinese-search-giant-baidu-hires-man-behind-the-google-brain/ http://www.technologyreview.com/news/527301/chinese-search-g...
- dang 12y agoThanks. We changed the url to that from http://www.marketwatch.com/story/baidu-opens-silicon-valley-lab-appoints-andrew-ng-as-head-of-baidu-research-2014-05-16 http://www.marketwatch.com/story/baidu-opens-silicon-valley-....
- varelse 12y agoThe most interesting thing about this announcement is the huge emphasis on GPUs at Baidu driven by Ren Wu: http://on-demand.gputechconf.com/gtc/2014/presentations/S4651-deep-learning-meets-heterogeneous-computing.pdf http://on-demand.gputechconf.com/gtc/2014/presentations/S465... Combine this with Andrew Ng, whose own student Adam Coates matched Google's cat detector network with 64 consumer grade GPUs, and we are in for interesting times... http://www.stanford.edu/~acoates/papers/CoatesHuvalWangWuNgCatanzaro_icml2013.pdf http://www.stanford.edu/~acoates/papers/CoatesHuvalWangWuNgC...
- ccubess 12y agoAdam Coates has done many more impressive things than that. The "cat detector" was an uninteresting piece of research and not very impressive at all. The image net results were bad and nets trained on one or two gpus were doing much more interesting things.
- mark_l_watson 12y agoIn Hinton's Coursera class, which was very good, he made a strong point about GPUs being the way to go (at least for now) in building deep learning networks.
- visarga 12y agoWhy are they still using GPUs? Maybe hardware companies should start making AI targeted processors instead. Could they boost performance 10 times with a dedicated processor?
- strebler 12y agoBaidu's deep learning based image search is actually quite impressive: http://shitu.baidu.com/ http://shitu.baidu.com/
- cliveowen 12y agoshitu, not the best choice of word.
- vvvv 12y agoI don't know why you got donwvoted, your comment is perfectly valid. Plenty of case studies about Anglo-Saxons making silly linguistic faux pas in other countries, including China. China has a huge domestic market but the companies there will eventually also have business case studies warning against "shitty" linguistic mistakes ;)
- ewoodrich 12y agoThis, however, is a site in Mandarin targeted at Chinese. "Shitu" is not intended for Western markets, it just happens to appear in Latin script in a URI.
- btian 12y agoIt makes perfect sense in Mandarin, and since it's a Chinese site, I'll call it a reasonable choice of word.
- seanmcdirmid 12y agoI'm sure we could form a pejorative from it. Like 你是土, pinyin is just so ambiguous.
- yen223 12y ago你是吐, for when you want to look for a spitting image of yourself ;)
- 12y ago
- auston 12y agoAndrew, is in my opinion, one of the smartest people alive today. Call it what you'd like, but I'd love to see his work going into an American company.
- btrombley 12y agoI 100% agree that Andrew is one of the smartest people I've ever met, but I for one wouldn't mind if Baidu started to challenge Google in the deep learning space. International competition will be better for American companies than Google's current monopoly on the research and experts.
- goldfeld 12y agoIt never ceases to amaze me how many americans completely overlook this in their blind patriotism. Baidu today may well be the only company able to challenge Google's strength on the search engine land, and an effective monopoly (i.e. if Google got their way with China and toppled Baidu) would be sad for mankind. Here's hoping instead that a breath of american mindset at Baidu can slowly make it reach out of China and who knows, challenge Google with (non-censored as in China, and non-NSA'd as in Google) english results.
- justicezyx 12y agoGiven Baidu's long history of being "cooperative" with Government, I cannot support such a company to be an effective competitor to Google. Besides, deep learning is about far more than just search.
- xux 12y agoYou can say the same about Google.
- DominikR 12y agoEvery company has to be cooperative with its government, or relocate/close. It just happens that Google isn't based in China, therefore they were able to make the decision not to expand to China. But in the US, Google will have to accept basically anything the government demands, as long as it is backed by the courts. (which isn't that hard since the government just invents secret courts based on secret laws that back almost 100% of the governments demands)
- ChuckMcM 12y agoWow, that was unexpected. I admire Ray Kurzweil but Andrew has always struck me as that rare sort of person who can both see the big picture and pick out the stepping stones to getting there. That is incredibly valuable and I did not expect that Google would let him be poached by a rival search company.
- chriskanan 12y agoI think Andrew had already severed his official ties with Google when he started Coursera, since he was probably the person to recommend Google hire Geoff Hinton to replace him (see [1]). If Andrew had returned to Google, I don't think he would have as great of a leadership role as the one that Baidu is offering to him, since there are several other AI leaders that are just as prominent, if not more so, at Google (like Hinton and Kurzweil). [1] http://www.wired.com/2013/03/google_hinton/ http://www.wired.com/2013/03/google_hinton/
- presty 12y ago> since there are several other AI leaders that are just as prominent, if not more so, at Google (like Hinton and Kurzweil). Norvig > Kurzweil
- rpm4321 12y agoNorvig himself has a different take on that: http://www.youtube.com/watch?v=zihTWh5i2C4#t=86 http://www.youtube.com/watch?v=zihTWh5i2C4#t=86
- krick 12y agoNothing of a "different take" out there. And even if there would have been, it's only natural to speak praisingly about somebody you introduce.
- kordless 12y agoI just watched Norvig's 100K student talk. Quite impressive and mind blowing to think about.
- chriskanan 12y agoAndrew Ng on why he decided to leave his day-to-day responsibilities at Coursera for Baidu: http://blog.coursera.org/post/85921942887/a-personal-message-from-co-founder-andrew-ng http://blog.coursera.org/post/85921942887/a-personal-message...
- sytelus 12y agoUsual fluff. Only relevant part is, With the MOOC movement healthy and growing, I now plan to dedicate more of my time toward AI (Artificial Intelligence) and machine learning. I will be joining Baidu as their Chief Scientist to help build out a research organization, headquartered in Silicon Valley. Both education and AI have been longstanding passions for me. I believe some of my skills will allow me to make a contribution to the latter.
- happyscrappy 12y agoBaidu has a long history of being one of the most proactive and restrictive online censors in the search arena so how does he reconcile this contradiction?
- superduper33 12y agoCareface.
- asdfologist 12y agoMoney.
- justicezyx 12y agoI think it's natural for Baidu to offer this kind of search capability as a means to hunt down restricted information disguised in non-text format.
- pjungwir 12y agoWow, I just finished his Coursera ML class this week. I hope that course continues to be offered. I wish I could tell him thanks for teaching it! The way he balances cutting-edge research with popularization of hard concepts reminds me of Richard Feynman. Best of luck to him.
- frankchn 12y agoIt will definitely still be offered -- that was one of the questions we asked him at All Hands yesterday :).
- willis77 12y ago> reminds me of Michael Feynman Richard Feynman?
- pjungwir 12y agoUh, yes. :-) Edited....
- deleted 12y ago[deleted]
- akilism 12y agoI just finished this also. Great course.
- re_todd 12y agoYeah, what coincidence. I was just watching one of the Coursera ML videos on Linear Algebra less than 15 minutes ago. He's such a good teacher, he makes ML look so approachable.
- deleted 12y ago[deleted]
- bayesianhorse 12y agoHm, leaving Coursera to work at the most censored search engines of all times? Not a good day for humanity...
- deleted 12y ago[deleted]
- billmalarky 12y ago"For now, relatively few people are versed in the tricks needed to get deep learning to work well" How does one exactly become one of these people? Is any of this information public yet?
- presty 12y agoCould you clarify your question? Are you asking how does one become an AI/ML expert? The traditional path is to study CS/EE-AI-ML and become a researcher. Most of the academic/industry papers are available. Just browse the nips/icml/sigir/etc conference websites. But then you'll need to apply that knowledge - ideally by working in the industry. Or you can go try your luck in kaggle and other competitions.
- eshvk 12y ago> Is any of this information public yet? Most Machine Learning research that is not done by top secret labs is available publicly. Start looking at papers by Geoffrey Hinton. Could also take a look at word2vec if you are into NLP.
- apu 12y agoThe other responses to your question tell only part of the story. Yes, the academic groups that work in deep learning publish papers describing their methods. But these papers are rarely sufficient to be able to recreate the models they built. There's a lot of other knowledge/expertise/intuition that's required to make working implementations. There have been some deep learning tutorials at recent conferences that might be more in-depth. (See my previous comment [1] for details.) Another good way to learn is to look at some open source implementations, such as caffe from berkeley [2] or overfeat from NYU [3]. In addition to showing how to choose architectures or set params, they also have tricks for speeding things up. This is actually very important, as they can make orders of magnitude difference (training in hours vs days). [1] https://news.ycombinator.com/item?id=7742192 https://news.ycombinator.com/item?id=7742192 [2] http://caffe.berkeleyvision.org/ http://caffe.berkeleyvision.org/ [3] https://github.com/sermanet/OverFeat https://github.com/sermanet/OverFeat
- 12y ago
- ant_sz 12y agoAs a Chinese I have to say baidu dose have a bad reputation even in this country. Even my friends that works at baidu feels confused after heard this. Baidu devotes a lot in algorithm and machine learning. But when it comes to Chinese market we can see that technology does not even play an important role in one companies' success (marketing and government relations plays a more important role). I am wondering how long will baidu keep investing in deep learning as it has so many troubles in international market (where technology really matters).
- LiweiZ 12y agobaidu sucks. And we Chinese know it. I guess it has to keep investing in relatively advanced tech to keep its high tech image for China market in U.S. stock market. This at least is one of the results baidu wants.
- tiatia 12y agoThey should have hired Chuck Norris instead to shoot all the people that block the internet in China or make the internet slow. With slow I mean slowing gmail down by factor 40.
- tiatia 12y agoEvery Bozo downvoting this has obviously never lived in China
- ternaryoperator 12y agoI expect the downvotes have little to do with true/untrue, but rather that the comment is off topic and doesn't advance the conversation.
- galfarragem 12y agoChina is in the process of becoming a real superpower. They are making what US made last century: attracting brains. http://www.universityworldnews.com/article.php?story=20140326132305490 http://www.universityworldnews.com/article.php?story=2014032...
- tomaskazemekas 12y agoIt looks like the trend of search engines becoming more like recommender systems will continue.