3 ms·
I'm not a large scale ML person, and not intending to take away from the achievement of the team in the OP, but experiments in large scale, unsupervised learnin
by mturmon 14y ago
I'm not a large scale ML person, and not intending to take away from the achievement of the team in the OP, but experiments in large scale, unsupervised learning have been going for a long time (even using the autoencoder approach). When you think about it, large scale requires unsupervised...
Here is an old example with hundreds of millions of records and instances:
http://aaaipress.org/Papers/KDD/1998/KDD98-028.pdf http://aaaipress.org/Papers/KDD/1998/KDD98-028.pdf
Both authors are now with Google.
Also, people here may not be as up to speed on the state of the art in face rec as they think they are. It's not as much of an unsolved problem as it was even 10 years ago.
- marshallp 14y agoFace recognition usually uses a hand-coded layer followed by a machine learning algorithm. This technique automatically devises that hand-coded layer. It also did this for 20,000 other categories and can also be applied equally well to audio or any other data type. Huge difference.
- mturmon 14y agoThe large-number-of-categories result was the most novel and surprising to me.
- JohnHaugeland 14y ago"When you think about it, large scale requires unsupervised..." Not necessarily. Crowdsourcing is another option, like Google's image tagging game, reCAPTCHA, et cetera. Pay a herd of people to do things, and they'll do things for you. You don't have to pay them in money. Telling them they have a high score is often enough.
- mturmon 14y agoYes, "requires" was too strong. I should have said they go well together. I was trying to get at the fact that it's highly common for large-scale work to be unsupervised.