7 ms·
Sigh. I don't know whether I'm alone in being saddened that many of the excellent thinkers of our time, who once might have spent their lives probing the the ve
by kolektiv 14y ago
Sigh. I don't know whether I'm alone in being saddened that many of the excellent thinkers of our time, who once might have spent their lives probing the the very limits of our comprehension in their field, now end up comfortably turning their minds to the services of (in the long term) rather short sighted commercial ends.
I can imagine that this sentiment is probably against the prevailing HN mood, but I've been thinking a lot lately about how certain kinds of thought and investigation are only enabled and supported by certain structures. The point of a university used to be being the highest pinnacle of thought. A place where people could have everything not related to intellectual pursuit taken care of so they could devote themselves to the pursuit of greater knowledge. Now that seems to be replaced by a corporate campus.
It's a cliche, of course, but how many breakthroughs of meaning are we missing out on because the brightest and best of our generation are now no longer seeking after truth, but instead seeking after a way to make more people click on an ad? Ah well, it's late, and as ever I'm post-sober. Best of luck to him and his team - I've enjoyed his lectures and papers. I hope they may continue, but I sadly suspect not.
- DannyBee 14y agoYou have this impression of universities that i don't believe has been true for at least 100 years, if not more. Research professors at schools have been mostly funded by either commercial or military interests for a very long time now. Even in non-direct cases, universities have "tech transfer" offices that are commercializing stuff, and continued funding often depends on that. If you are going to claim this model is bad and that it produces bad results, you are going to have to offer at least a little evidence that the models that existed before this, worked, and were better for humanity. I might agree with the second part in some ways, but I dont' think they supported anywhere near the amount or level of research that occurs now. Research is definitely more goal directed than it used to be, but this is not totally good or totally bad, it's just "different".
- cscheid 14y agoThe Bayh-Dole act is less than 100 years old, but it is in my view one of the major causes of the phenomenon you describe. (It should also be, incidentally, taught as one of the great examples of unintended consequences: by all accounts it was designed to increase the independence of universities by letting them keep the monies they got from commercialization. Then somewhere along the way policy-makers realized Bayh-Dole was a great excuse to encourage universities to do tech transfer. And now essentially every grant that doesn't have some tech transfer proposal is almost automatically in trouble when compared against those that do.)
- dannyr 14y agoI read the book "In The Plex". A lot of academicians joined Google mainly because they wanted to get an actual product/service out into the hands of people instead of just doing research or writing papers. I have a different reaction than you. It's good to see brilliant minds stepping outside of the academia and join a commercial entity to actually build something.
- moultano 14y agoI don't think you can accuse Google of short sighted commercial ends here. The team he is working with has already done really groundbreaking stuff that falls right in line with his work. https://plus.google.com/u/0/+ResearchatGoogle/posts/EMyhnBetd2F https://plus.google.com/u/0/+ResearchatGoogle/posts/EMyhnBet...
- deleted 14y ago[deleted]
- rednukleus 14y ago1. They don't sell info, they just target ads 2. Google are an AI company, who currently make most of their profit from ads. They are well aware that there are big opportunities for them to make profits outside targeted ads.
- Mahn 14y agoGet over with this already. Everyone who's been paying attention to the company for the last, say, five years, knows that most of what they do doesn't in fact revolve around ads. Just because the company has a boatload of money and data doesn't make it inherently evil.
- balakk 14y agoI would argue that Google has had the largest impact on information dissemination , since the invention of pen and paper. Advertising is just a means for providing comfortable livelihoods to these excellent people. There's no better place for these people to be working. We got some spectacular output when some bright folks ended up working together in a phone company, better than any university. Why not Google?
- minwcnt5 14y ago> Advertising is just a means for providing comfortable livelihoods to these excellent people. I'd say it's a bit more than that; what Google has done in advertising has benefitted millions of consumers and businesses. I'm not sure why people tend to look down on some of the work they do in advertising as somehow being less worthy than working on GMail or Search!
- OGinparadise 14y agoNot the means, it's the end, and everything feeds to that. Especially search with their "updates," Chrome, Android, UI etc. Hinton has his work cut out, make users click on ads! Looks like playing with colors has been milked already. "I would argue that Google has had the largest impact on information dissemination , since the invention of pen and paper." Because they are a search engine and is used by most people. Now, however, Google is replacing information with ads and with sub-par information that is beneficial to their bottom line. That hurts creators, readers and society in general.
- jmathai 14y agoI think the biggest difference is that the knowledge gained in the context of a university is open and easily built upon by anyone else. The saddest part of corporations replacing academia won't be realized for decades but it's that the death of knowledge is tied too closely with profitability. The decision of what to do with one's life rests entirely in him or her. But we should ask as a society, what are we striving for? The same goes to how our society (I can only speak of the US) looks at teaching as a profession. </zenmode>
- jiggy2011 14y agoTo be fair , google are doing a lot more than "making people click on ads". There must be a lot of genuinely cutting edge research into machine learning,classification,NLP etc going on in there. Google also serves the purpose of amplifying the power of great (and not so great) minds by putting so much information at their fingertips. The ads part is just what writes the cheques.
- jarek 14y ago> There must be a lot of genuinely cutting edge research into machine learning,classification,NLP etc going on in there. Does the research get published or otherwise make it outside of the Googleplex? Serious question.
- moultano 14y agohttps://plus.google.com/u/0/+ResearchatGoogle/posts/EMyhnBetd2F https://plus.google.com/u/0/+ResearchatGoogle/posts/EMyhnBet...
- zxtang 14y agohttp://research.google.com http://research.google.com For reference, I googled "research at google".
- Locke1689 14y agoTo be honest... kind of. They release papers but most of the layers at the bottom are Google proprietary. Certainly the source code is proprietary. Hell, even most of the information about GFS is proprietary, despite having a successor. From an academic perspective, their disclosure is kind of crap.
- DannyBee 14y agoPlenty of academic research papers don't have code either. "Hadoop was derived from Google's MapReduce and Google File System (GFS) papers." So apparently the disclosure was good enough to give you that :) http://www.slideshare.net/jbellis/cassandra-open-source-bigtable-dynamo http://www.slideshare.net/jbellis/cassandra-open-source-bigt... Shows that cassandra is based on the bigtable paper, among others (hbase i believe was as well). Their disclosure is apparently good enough to get folks going ... FWIW: In reading 20 years of compiler papers, i've had more luck getting code for papers from commercial companies than academics. It's become somewhat better over time, but plenty of universities still seem completely unwilling to give code to papers.
- waterlesscloud 14y agoI've long felt Google's true mission is AI, the rest is just chaff for the investors.
- deleted 14y ago[deleted]
- cjbprime 14y agoFor what it's worth, I was thinking the same thing. I don't feel this way about Google hiring programmers in general, but I think at this point they've hired some significant double-digit percentage of the world-class machine learning professors in the world, and as I understand it those people don't publish (many) papers anymore.
- haberdasher 14y agohttp://research.google.com/pubs/ArtificialIntelligenceandMachineLearning.html http://research.google.com/pubs/ArtificialIntelligenceandMac...
- cjbprime 14y agoThanks, I didn't know about that. But you'll probably agree that it's unimpressive: 270 publications (and that appears to be all-time, going back 10 years) for a team of 515 researchers. In academia, you'd expect several per year per researcher.
- robotresearcher 14y agoThat's because at university the researchers are being evaluated mainly on the number of papers they produce. Google has other options for evaluation. Source: some bozos count my papers every couple of years and write an evaluation which displays complete ignorance of my field.
- ok_craig 14y agoThe common lament about Google being just a place that optimizes ad clicks is overused, and lazy thinking. I don't even think it's a conclusion that's the result of actual thought anymore, just reverb. Google is a big company. It would not even be worth it or effective to have every single engineer dedicated to this ad click business. There's a team for that, and there are lots of other teams, for lots of other interesting things. Many of them do serious intellectual research. My impression of Google's leadership, employees, and choice of projects often leads me to believe that they sell ads so they can continue making really cool stuff - not that they try to come up with cool stuff so that they can sell ads. I also disagree with the whole premise that goal-oriented or profit-driven intellectual study is in some way less pure, less worthy, less boundary-pushing, or more short-sighted than purely academic study. How does the initial incentive for a thought affect whether or not the conclusions from that thinking are new knowledge about our universe? It doesn't. As long as he's not sacrificing what he does to become a paper pusher, which he isn't doing, I don't see how it's different. And I think ultimately the closer his study is to being manifested in real things that we use, the faster his knowledge will be refined towards the path of truth, and the faster humanity will actually learn and benefit.
- wtallis 14y agoGoogle simply hasn't been around long enough to earn the kind of credibility that Bell Labs and Xerox PARC had.
- gajomi 14y agoTo the extent that they don't have that kind of credibility (I think I agree with your assessment) whatever the eventual result of Hinton joining the team should say something very strong about whether or not they will. If he finds that he isn't getting what he wants out of it, I think we can expect him to leave. If he ends up staying it is evidence that Google can hold the interest of the sort of people you would expect to find at places like Bell Labs.
- minwcnt5 14y ago
- ibuildthings 14y agoOn the contrary, I think these are symptoms of machine learning coming of age [or getting industrialized]. I am not sure "short sighted commercial ends" are the main motivator for likes of Prof. Hinton to shift, but rather the availability of vast amount of data and opportunity to understand them in a scale which was not previously possible. To bring out the real magic out of techniques like deep learning ( http://en.wikipedia.org/wiki/Deep_learning http://en.wikipedia.org/wiki/Deep_learning ), availability of large training sets and the infrastructure required to crunch them are a pre-requisite. Once you have that, it is turning out to be a different ball game all together http://deeplearning.net/2012/12/13/googles-large-scale-deep-learning-experiments/ http://deeplearning.net/2012/12/13/googles-large-scale-deep-.... It turns out that groups like google research are the ones at present which have access to such dataset and infrastructure. I also predict the reverse shift to happen within few years, once the interesting fundamental research problems has been tackled such people might move back to universities. If that happens, that is indeed a healthy process of academica and industry supplementing each other.
- karpathy 14y agoThe problem with this type of research in particular is that these deep learning networks shine when they are trained for a very long time across many machines, and on huge quantities of data. In other words, serious engineering muscle is necessary that goes beyond what a few graduate students can do in a University setting.
- stiff 14y agoIt remains to be proved that an university is particularly better at innovation that anything else. At least in Computer Science most major historic breakthroughs happened in army departments and in commercial laboratories (Bell Labs, Xerox Parc) and today they are still strong, for example many of the most cited CS publications come from Microsoft Research. Google faces some of the biggest challenges in Machine Learning and has some of the brightest people in the field, I doubt they will be looking for "ways of making people click on an ad". The advantage of a commercial or military laboratory is the constant flow of new problems needing to be solved that can give everyone huge visible benefits, it is emotionally stimulating, in comparison to the somewhat vacuous atmosphere of an universities thinking for thinkings sake.
- slightperturb 14y agoOf the most-cited 20 papers in CS (from citeseer), the affiliation of the first author of all but four is with academia: Academia -------- 1) Maximum likelihood from incomplete data via the EM algorithm, 1977. Dempster, Harvard. 2) Communicating sequential processes, 1978. Hoare, Oxford at time of publication. 4) Chord: A scalable peer-to-peer lookup service for internet applications, 2001. Stocia, Berkeley. 5) Distinctive Image Features from Scale-Invariant Keypoints, 2004. Lowe, UBC. 6) Induction of Decision Trees, 1986. Quinlan, New South Wales Institute of Technology. 7) Reinforcement Learning: An introduction, 1998. Sutton, UAlberta. 9) Graph-based Algorithms for Boolean Function Manipulation, 1986. Bryant, CalTech. 10) Scheduling Algorithms for Multiprogramming in a Hard-Real-Time Environment, 1973. Liu, MIT. 11) The anatomy of a large-scale hypertextual web search engine, 1998. Brin, Stanford. 12) A method for obtaining digital signatures and public-key cryptosystems, 1978. Rivest, MIT. 14) A scalable content-addressable network, 2001. Ratnasamy, Berkeley. 15) New directions in cryptography, 1976. Diffie, Stanford. 16) Eigenfaces for recognition, 1991. Turk, MIT. 17) Authoritative sources in a hyperlinked environment, 1999. Kleinberg, Cornell. 18) Indexing by latent semantic analysis, 1990. Deerwester, UChicago. 20) Handbook of Applied Cryptography, 1996. Menezes, UWaterloo. Industry -------- 3) A tutorial on hidden Markov models and selected applications in speech recognition, 1989. LR Rabiner, Bell Labs. 8) Optimization by simulation annealing, 1983. Kirkpatrick, IBM. 13) Snakes — active contour models, 1987. Kass, Schlumberger Palo Alto Research. 19) Fast algorithms for mining association rules, 1994. Agrawal, IBM.
- pmelendez 14y agoNot being the biggest fan of Google anymore, I got somehow saddened when I first read the news. But after a second thought, I can understand why he did it and if I were in his shoes I would do the same. I don't think it has to do anything with money. For a connectionist, it is a dream to have access to the massive amount of CPUs that Google has. Take that and add all the incredible and smart people that Google has in its team and then you would see his decision was a no-brainer. I feel very happy for him.
- dkersten 14y agoI worry that much of his groundbreaking work will now not be released to the public, or at least, not until it is no longer groundbreaking, instead looking out for corporate interests first and foremost. I don't fault the guy for this move, it certainly makes sense, but I hope we still get access to his research an future discoveries and work.
- arobbins 14y agoCommercial motivations often drive academic achievements. Why assume it is the end of his contributions? This situation seems similar to Guinness' practice of hiring all the best graduates from Oxford and Cambridge. EDIT: Can't have apostrophes in links Search wikipedia for Student's t-test history old, broken link: http://en.wikipedia.org/wiki/Students_t-test#History http://en.wikipedia.org/wiki/Students_t-test#History
- xyzzy123 14y agoWhat if you consider the application a trojan horse for doing interesting things which are useful well outside the supposed domain of application? I think the trope of "the best minds working on ad clicks" is perhaps not giving people enough credit. Hackers and academics always find a way to screw around and work on interesting things. The trick is to find interesting structure in mundane problems.
- mindcrime 14y agoThe point of a university used to be being the highest pinnacle of thought. A place where people could have everything not related to intellectual pursuit taken care of so they could devote themselves to the pursuit of greater knowledge. Sounds good on paper, but I'd question if that was ever actually true in reality anyway. Now that seems to be replaced by a corporate campus And? Is research less valuable because it's done by a corporation? Look at how much basic research IBM sponsors and how much Bell Labs and others have sponsored in the past. If anything, I would go the opposite direction and lament the decline in corporate spending on fundamental research. I'd like to see more academics go into the business world. "Startups are the new graduate school" - can't remember where I heard that quote, but I think there's something to it.