8 ms·
Jeff Dean explains TensorFlow [video]
- codyguy 11y agoYay!! An open sourced voice engine in the future? That would really shake things up.
- IshKebab 11y agoNo. a) Stuff similar to this has been available for ages and there are no (good) open source voice recognition packages. b) It requires absolute mountains of training data which we don't have. c) It requires designing a suitable network, which I'm not sure if we have, but I would doubt it. d) It requires training a network on the mountains of training data using an immense computing cluster, which we requires money that we don't have. Don't hold your breath.
- swah 11y agoCan anyone explain why was this downvoted?
- codyguy 11y agoI agree there. Plenty to be done still.
- ambiate 11y agoSometimes creativity is the only thing holding people back from exploiting the natural insects of the web. Case in point, ever wonder why those captchas include street addresses or 'pick the shape with a hole in it?' Spoiler: you're building training data and validating training data. How else can we silently retrieve training data?
- mmytest 11y agoI like this link
- alttab 11y agoThis was a great watch. It made me want to apply to the residency program. Edit: wasn't sarcasm.
- narrator 11y agoFYI, Jeff Dean is the inventor of most of Google's distributed computing infrastructure including MapReduce. Definitely up there with the likes of John Carmack and Fabrice Bellard as one of the great software engineers of all time.
- fmela 11y agoThe Jeff Dean Facts are worth reading: https://www.quora.com/What-are-all-the-Jeff-Dean-facts https://www.quora.com/What-are-all-the-Jeff-Dean-facts Personal favorite: "Jeff Dean once shifted a bit so hard, it ended up on another computer."
- lgas 11y agoI'd wager that way more people know who Jeff Dean is than know who Fabrice Bellard is.
- kybernetikos 11y agoMaybe some people do, personally I'm more familiar with the works of Fabrice Bellard, and that's probably fair enough since I expect I have more pieces of software derived from Bellard projects installed on my machine than I do software derived from Jeff Dean projects (not to criticise Jeff Dean, who I'm sure is very inspirational).
- 11y ago
- argonaut 11y agoJust wanted to repost this from the other thread on TensorFlow, since I joined the party a bit late: I think some of the raving that's going on is unwarranted. This is a very nice, very well put together library with a great landing page. It might eventually displace Torch and Theano as the standard toolkits for deep learning. It looks like it might offer performance / portability improvements. But it does not do anything fundamentally different from what has already been done for many years with Theano and Torch (which are standard toolkits for expressing computations, usually for building neural nets) and other libraries. It is not a game-changer or a spectacular moment in history as some people seem to believe.
- deleted 11y ago[deleted]
- tachyonbeam 11y agoI'm curious how the performance and scalability compares with Theano and Torch. I'm thinking the reason Google built this is that they wanted to scale computations to really large clusters (thousands, tens of thousands of machines) and the other options didn't really cut it.
- miket 11y agoHere's a page with various benchmarks: https://github.com/soumith/convnet-benchmarks https://github.com/soumith/convnet-benchmarks An issue has been created to add TensorFlow to this shortly.
- lacksconfidence 11y agoThis looks to be a single machine test, where this video and the poster above specifically talked about running against compute clusters. I don't think a single machine benchmark is going to be nearly as interesting.
- smhx 11y agoThey didn't release the multi-machine version of TensorFlow. They said they're still working on it and will release it when it's ready.
- theCricketer 11y agolove u guys
- deleted 11y ago[deleted]
- shostack 11y agoIs there anything an "early" programmer like myself can do to play around with this stuff without a background in the related math? I'm dying for this stuff to be dumbed down enough where Joe WebUser can feed in arbitrary data in a csv or point an app at a data source and get some sort of meaningful results. It truly seems like an area where once the barrier to entry is greatly reduced, the creativity of laymen will lead to some truly amazing executions.
- codyguy 11y agoHi shostack, You can try out ThatNeedle API. http://www.thatneedle.com/nlp-api.html http://www.thatneedle.com/nlp-api.html . While it is only catering to retail for now. The underlying capability is broader and generic. If you have specific needs, let's get in touch and discuss. You should at least take a look at the gif demo on the site.
- chm 11y agoI'm dying for this stuff to be dumbed down enough[...] It kind of already is. Have you read the docs/examples? I don't think your mentality is fruitful. Having argued with people who shared your point of view, it seems there will always be something too difficult that prevents them from being good at X. There's no substitute for sweat. Have fun with the code they gave you and see where you end up!
- shostack 11y agoI think we have different definitions of what "dumbed down" means. I never said I could/would never put in the work to learn it. I'm saying that the place it is in right now is still too advanced for someone with my background to pick up and play around with without sitting down to seriously study the underlying concepts that are objectively fairly dense subject matter that can require advanced math and CS backgrounds. To be clear, I'm not advocating that everything should be dumbed down for the sake of it. My point was largely that when the barrier to creation gets low enough, more creative types that don't have the heavy technical backgrounds can pick it up and create things that more technical users may never have imagined. Not everything is best served as remaining elusively complex for the layman. Also, for the record, I will probably read up on some of this stuff because I find it interesting and enjoy learning. I just wish it was a step more accessible than it is today, even with this development.
- houselync 11y agoholle!!!!!!!
- oiduts 11y agoThis is from ~22nd of October, and he is being asked whether it is an internal thing or going to be released - his answer is that it is internal and there are no plans to release it. Did they change their mind in a couple of days (not likely)? Was he not in the loop (also unlikely)? What else?
- ozgung 11y agoMaybe touching to lips gesture is a body language sign of not telling the exact truth: https://youtu.be/90-S1M7Ny_o?t=2043 https://youtu.be/90-S1M7Ny_o?t=2043 He says "I don't have anything to announce" so technically not lying.
- hooloovoo_zoo 11y agoWho cares? Gradient descent is bandwidth limited not software limited. (edit: for ANNs)
- Houshalter 11y agoOnly for some applications, I think.
- Kiro 11y agoJeff Dean has an amazing resume. He designed and implemented MapReduce, BigTable and much more. OT but how much does a super engineer like him get paid at Google?
- EwanToo 11y agoLargely it'll come down to how much money he wants. His salarly will probably be in the 6-figures, but he'll be a millionaire many times over. He joined Google in 1999 (IPO was in 2004), so his stock will have made him a very rich man.
- argonaut 11y agoWay off. He's a Senior Google Fellow and his bio used to be on the executive leadership page of Google (I can't find that page any more). He is being paid on the order of 10MM per year, base, easily.
- EwanToo 11y agoPerhaps, I doubt his salary is that high, but he'll have significant amounts of of stock grants, options, etc. Executive compensation is a very odd area, as I said, it pretty much depends how much money he wants.
- argonaut 11y agoYeah I should have been more clear. But I'm pretty sure his equity alone is more than $30M / year.
- amelius 11y agoIt would be great if one could automatically dispatch this to a commercial cluster. So you could say: I want this network to be trained in 1 day, and the system would say: that would cost $X, and it would instantiate some AWS/Azure/Google instances, and run the task.
- deleted 11y ago[deleted]
- vonnik 11y agoTensorFlow looks amazing, and the Google team deserves huge kudos for open-sourcing it. It may well become one of the best supported OS DL frameworks out there. People have been asking about its fundamental differentiators. I'm not sure there are any. Theano and Torch already set a pretty high standard. We know what good tools look like, and those tools exist even if they're getting incremental improvements. Now it's just a matter of building really cool things with them.
- thearn4 11y ago> TensorFlow™ is an open source software library for numerical computation using data flow graphs. > ... > Gradient based machine learning algorithms will benefit from TensorFlow's automatic differentiation capabilities. As a TensorFlow user, you define the computational architecture of your predictive model, combine that with your objective function, and just add data -- TensorFlow handles computing the derivatives for you. Interesting, it kind of look like the machine learning focused version of NASA's OpenMDAO (also a graph-based analysis and optimization framework with derivatives, but for engineering design).