6 ms·
Google & Stanford create a digital brain that learns to identify a human face
- peterhajas 14y agoThe article doesn't go in depth in the way of technical details (instead going for Terminator-joke knee jerkers), but I wonder how different this is when compared to a traditional neural net. Sure, a neural network wired up to pixels of images wouldn't be able to come up with the word "face", but it would certainly group things correctly, right? Using keypoint matching to "grade" guesses, you could seemingly train the network appropriately. Fascinating stuff. I just wish for a less fluffy article. Excited for the white paper.
- cs702 14y agoThe system apparently did not require any training by humans; instead, it learned to catalog different types of images, including those of human faces, on its own. (In other words, all images were unlabeled.) Paper here: http://arxiv.org/abs/1112.6209v3 http://arxiv.org/abs/1112.6209v3 [UPDATE: fixed erroneous statement.]
- peterhajas 14y agoThanks for the link to the paper, I'm very excited to read it. I wish this were posted instead.
- laserDinosaur 14y agoWith all the random hyphens in the text, I can't help but read it in the voice of G-Man from Half Life. Creepy.
- deleted 14y ago[deleted]
- peterhajas 14y agoThis is far more advanced than traditional face detection (such as Haar feature detectors and similar). This required no training or human intervention, and used machine learning (without guidance or training by man) to recognize faces.
- agrubb 14y agoThe original work was posted and discussed here previously: http://news.ycombinator.com/item?id=4145558 http://news.ycombinator.com/item?id=4145558
- ya3r 14y agoAnd the title is absurd.
- iandanforth 14y agoI think about this stuff a lot as part of my day job. I'll discuss the good and the bad. I would say the most important part of this paper is the 1. the Size and 2. the Number of images. The size of the model isn't huge. Most people don't realize that computer vision research is done using tiny sets of tiny images. Think hundreds to thousands of images that are 32x32 grayscale or black and white. Google did 10 million 200x200 color images. For a conservative comparison human vision can be thought of as two 15 megapixel cameras capturing at 30 frames per second. (The real numbers are higher and much more complicated.) I suspect that given this amount and quality of input data most machine learning algorithms would have produced better than state of the art results. Now the bad. Their model totally ignored time. Most computer vision researchers work with static images. In biology there is no such thing as a static image. Everything moves. You move, your eyes move, the environment moves. The brain, as an exception, can understand static images, but the rule is motion. A majority of features in biological vision are tied to motion. Light/dark change cells, moving edge change cells. A huge portion of the information you derive from sight comes from the temporal context of a given moment. The change from moment A to moment B is directly encoded and learned and is often more important than the state at A or the state at B. I'm not faulting them, in fact, I am extremely happy with their results, but I want to point out that these results can and will get much better in the near future as the input size increases and people start to integrate temporal features into their models.
- fghh45sdfhr3 14y agoOn the one hand I am an experienced software engineer with a computer science degree. On the other hand I was never interested in AI and I basically know "nothing" about AI, computer vision and artificial neural networks. AI always seemed too far off and bothered my engineering spidey sense for intractable problems. So I may embarrass myself with the following... The more software engineering experience I get the more neural networks bother me. I have not studied them in detail... and yet, they seem like a crappy solution. Throw a lot resources at something, add a bit of math and push a pile of data through. Does that ever lead to result that can't be bested though simpler more traditional methods? For example, the math behind how the network is organized and learns, that same math can be used to write algorithms which reveal patterns in data. Patterns which can then be studied further. Then there is the doing of things. What ever pattern is responsible for doing something in a network, the same function can be described much more simply by an algorithm. It just seems like neural networks would be interesting only if an alien spaceship with stupefying computing resources fell on us. And it fell on us in such a way that we could fully utilize the power of this new super computer while at the same time we could not learn anything new about algorithms or anything else. Only then does it seem like "train the neural network" is a smart strategy. In every other scenario is just seems like a decent if somewhat lazy start to an investigation. Really just a way to kick the tires of a problem. So did I just completely embarrass myself with my lack understanding of ANNs?
- jmduke 14y agoThis article is incorrect. >Historically, machine learning has generally been supervised by humans. There are plenty of examples of computers identifying human faces (or cats) with incredible accuracy and speed — but only if human operators first tell the computer what to look for. That the Google/Stanford system starts from scratch and develops its own ability to classify objects is amazing. Unsupervised machine learning has been around long before this feat -- which is nonetheless very impressive.
- duaneb 14y agoI think their point was that this was the first unsupervised system to achieve such good results. EDIT: Of course, that may have been due to the fact of better data/more processing power -> more time.
- marshallp 14y agoThe algorithm they used did not exist before 2005. Also since 2005 this algorithm had been mostly trained using just 1 computer at time (usually with gpu's). The supercomputer setup is novel for this. Most of the machine learning community had been disregarding this algorithm since 2005, until the past couple of years it started making dramatic showings, such as - Microsoft Research speech recognition system in 2011 (done by one of geoff hinton's students interning there) - NEC labs, ronan collobert - real-time natural languaege parser - first real-time parse ever - 2010 (trained on one computer for 3 months using wikipedia) - Google Research 16,000 node billion connection network - december 2011
- jmduke 14y agoAgain, I don't mean to disparage the achievement! But the article implied that Google invented unsupervised learning, which they didn't.
- caycep 14y agois this covered in the Coursera.org course? :P
- ivoflipse 14y agoNope, but who knows if they'll do a follow up on ML-class. But Yann LeCun posted this [1] as a response to Andrew Ng linking to his article on Google+. Basically its a summer school about Deep Learning taught by Andrew Ng, Yann LeCun and Geoff Hinton (and others). The video's should end up online. [1]: https://plus.google.com/104362980539466846301/posts/hhMJsPQyNcp https://plus.google.com/104362980539466846301/posts/hhMJsPQy...
- otoburb 14y agoIndirectly, yes. The Coursera course teaches K-means clustering as an example of an unsupervised learning algorithm, along with a technique to work with larger data sets in a more manageable way (e.g. PCA to reduce dimensionality). With the basic building blocks from the ML course you have a much better understanding of what Google and Stanford did. Andrew Ng is also the course instructor for the Coursera ML course[1]. I am presuming that supplemental readings and Youtube videos by Prof. Ng (e.g. http://www.youtube.com/watch?v=ZmNOAtZIgIk http://www.youtube.com/watch?v=ZmNOAtZIgIk) allows a sufficiently motivated individual to at least partially replicate the results in the OP. [1] Andrew Ng is also a co-founder of Coursera.
- tluyben2 14y agoWhat are the current limitations of 'just' creating this on a much (much) larger scale? For instance, 160.000 or 1.6 million cores and would it be a significant improvement? And for which other fields would that work? I do know about neural net theory and I worked with them in college assignments quite a bit 20 years ago, but I'm wondering if anyone here knows what differences this kind of scale will make or if it's just interesting for still images (in which i'm very much not interested).
- marshallp 14y agoThe amazing thing about this algorithm is that it works for any data type (my other comment talks about speech and nlp). With more computers and more data it will keep getting better - i've thought a lot about this and following this stuff for a couple of years - so it's not just some idle speculation. (I broke this recent story on hacker news a few days ago, and from here it got picked up by the new york times and spread everywhere else).