9 ms·
Google Brain Residency
- wyldfire 9y ago> I believe my motivating demo will be achieved some day soon—you will watch Charlie Chaplin in 4K resolution and it will be indistinguishable from a modern movie. Wow, where does it stop, then? Can we upsample modern 4k films? Or deeper dynamic ranges? Stereo projections from mono images? I suppose that the limiting factor is the resolution/color depth/perspective channels of the training images?
- deleted 9y ago[deleted]
- zitterbewegung 9y agoSince this would probably be more like it is inferring the signal by correlating movies that have similar elements you would need an dataset of 8k signals / dynamic ranges / stereo projections and then you can attempt to perform the up sampling. You were right in your last statement.
- deleted 9y ago[deleted]
- clay_to_n 9y agoI don't see why you'd need a dataset of 8k images in order to upsample 4k to 8k, as long as there are 4k images of that object from at least twice as close as you're shooting from. (Actually I think twice as close might be 16k, but you get the point...)
- phreeza 9y ago4k refers to the number of lines, so twice as close is 8k.
- santaclaus 9y ago> I believe my motivating demo will be achieved some day soon—you will watch Charlie Chaplin in 4K resolution and it will be indistinguishable from a modern movie. How do these sorts of techniques perform with respect to temporal coherence?
- jacquesm 9y agoIt will stop when you hand a computer a novel and a cast as well as the style of your favorite director and then it will produce the film. Think of it as the ultimate in video compression.
- spynxic 9y ago> It will stop when you hand a computer a __(representation)__ and an __(embodiment)__ as well as the style of your favorite __(artist)__ and then it will produce the __(artwork)__. Think of it as the ultimate in __(*)__.
- catmanjan 9y agoConsidering how hard it is to pick something to watch on Netflix, I think it will stop when the computer pre-empts what you want to see - 100 channels of interesting generated content!
- bluesroo 9y agoAnd there still won't be anything on TV!
- rahimnathwani 9y ago> 100 channels of interesting generated content If I have to choose a channel, or even choose whether to turn the TV on or off, there's still room for improvement.
- gabrielgoh 9y agoI enjoyed the section on negative examples, and the things that don't work out. Makes me feel a lot better about the ton of things i've tried which didn't quite pan out the way I hoped.
- frsandstone 9y agoFor context - the author of this article, Ryan Dahl, is also the creator of Node.js.
- ehsankia 9y agoThank you, that explains the "I uprooted myself from Brooklyn and moved, yet again, to the Bay Area in pursuit of technology." with a link to node.js in there.
- dekhn 9y agoyup, the very best machine learning models are still made from distilled postdoc tears...
- chis 9y agoThis is just incredibly impressive on the surface. I wonder if it could be used for compression of videos and pictures?
- tdb7893 9y agoIf you google something like "neural net compression" you'll see a paper on it. It doesn't beat standard compression right now as far as I know
- psb217 9y agoThere's some cool new work -- to be presented at ICML in August -- that claims practical improvements over existing compression methods by using neural nets for "adaptive compression". The authors are strong academic researchers and appear to have formed a startup around this tech. ICML is a rigorous venue, subject to selective peer review. This is also my area of expertise, though I'm not affiliated with the authors of this paper. Link to project: http://www.wave.one/icml2017/ http://www.wave.one/icml2017/
- santaclaus 9y agoI'm waiting for someone to train a NN to make over compressed Spotify streaming to sound not-crappy.
- spynxic 9y agoPerhaps the solution could be approached from the receiving end, during decompression, given some kind of information about the appropriate form of the decompressed stream.
- pbhjpbhj 9y agoLike feed in a compressed file (OGG or whatever) feed in a lossless file (FLAC say) and have the [ML] system create an algorithm to run at the receiver that will more closely approximate the lossless output. This has been done before surely, like compression with varying decompression algos the characteristics of which are sent with the compressed stream to enable more optimal reproduction of the originally encoded data??
- thebouv 9y agoI admit I'm a little disappointed that "Google Brain Residency" isn't a prototype for uploading your consciousness to "the Net". Loved the article though. Dashed cyberpunks dreams notwithstanding.
- tricolon 9y agoI was half-expecting it to be about their invention assignment agreement.
- ramgorur 9y agoThe colouring algorithm is very interesting, what if we give a dinosaur image as an input after learning the network with images from all the 10,000 reptile species?
- yorwba 9y agoIt will probably be colored somewhat grayish-green, since most reptiles are small animals that benefit from being able to hide in foliage. I doubt it will give better insight about dinosaur coloration than just having the illustrator who made the image also do the coloring (and they at least have the option of including fossilized pigments into their educated guess.)
- Zaheer 9y agoGreat article! I especially like how its understandable and relatable to folks not wholly within the ML space.
- popcorncolonel 9y agoI don't really see the point in prime classification, I feel like you're never gonna get better than doing a deterministic sieve algorithm. Even if it did do quite well in terms of accuracy, probabilistic models aren't 100% correct so you still have to check for primality deterministically. However the twin prime factorizer idea was interesting and could potentially lead to some factorization speedups (based on heuristics) if done correctly. Either way though, prime number distribution is quite tricky - we should probably be looking in other number bases as well rather than just base 10.
- reubenmorais 9y ago> Even if it did do quite well in terms of accuracy, probabilistic models aren't 100% correct so you still have to check for primality deterministically. Deterministic primality tests are rarely used in practice -- they're too slow, and the probabilistic tests have such a high accuracy that it doesn't matter.
- hulahoof 9y agoEither way though, prime number distribution is quite tricky - we should probably be looking in other number bases as well rather than just base 10. This interested me so I went looking for how primes would work in other bases, this answer implies that primes are the same regardless of base: A prime is a prime no matter which base you use to represent it. On the surface one might think that in Hex you would have 35 = 15 as "usual," but it really turns out that 35 = F. The example 21 doesn't work too well because it is not prime. The base ten number 37 is better, because it is prime, but its Hex representation is 25, which sort of looks non-prime. Hex 25 is not, however, repeat not, 5 squared. Okay, enough for examples. The fact of being prime or composite is just a property of the number itself, regardless of the way you write it. 15 and F and Roman numeral XV all mean the number, which is 3 times 5, so it is composite. That is the way it is for all numbers, in the sense that if a base ten number N has factors, you can represent those factors in Hex and their product will be the number N in Hex. Relating to your question about base 13, the base ten number 13 will be represented as "10" in that system, but "10" will still be a prime, because you cannot find two numbers other than 1 and "10" that will multiply together to make "10". I hope this helps you think about primes in other bases. [1] http://mathforum.org/library/drmath/view/55880.html http://mathforum.org/library/drmath/view/55880.html
- paultopia 9y agoThis is interesting: The program invites two dozen people, with varying backgrounds in ML ... "with varying backgrounds in ML" -- does that mean that relative beginners have a chance of being accepted? (I have a personal stake in this! I'm an academic researcher who is getting into ML and working on legal applications, and I'd totally apply for this if I thought you didn't have to basically be Andrew Ng to get in...)
- antognini 9y agoI was accepted to the 2017 class, so I can at least provide one data point. My background is in astronomy where I did lots of computational work, but no ML. After I got my PhD I went into industry working on applying NNs to EEG and EKG interpretation. I had a little over a year of industry experience in ML at the time I applied. I'm maybe not quite a beginner anymore, but I'm much closer to that end of the spectrum than being at the world-renowned expert end! I haven't met the other residents yet (the program doesn't start until mid-July), but based on a few online interactions and meeting some of them at the interviews it seems that a fair number are undergraduates or grad students with some research experience in ML or computer vision. Others seem to have backgrounds more similar to mine, i.e., they were researchers in physics or neuroscience or something and are transitioning to ML.
- paultopia 9y agoCoolness---thanks!
- gdahl 9y agoI work as a researcher on the Brain team. An experienced machine learning researcher like Andrew Ng would probably not join the team as a Brain resident. We hire experienced machine learning researchers and engineers all the time (see https://careers.google.com/jobs#t=sq&q=j&li=20&l=false&jlo=en-US&j=brain+research& https://careers.google.com/jobs#t=sq&q=j&li=20&l=false&jlo=e... ) and the residency program is probably not appropriate for people who are already experts. It is a program designed to help people become experts in machine learning. For residents we look for some programming ability, mathematical ability, and machine learning knowledge. If an applicant knows absolutely nothing about machine learning, it would be strange (why apply?). We accept people who are not machine learning experts, but we want to be sure that people know enough about machine learning to be making an informed choice about trying to become machine learning researchers. Applicants need to have enough exposure to the field to have some idea of what they are getting into and have the necessary self-knowledge to be passionate about machine learning research. You can see profiles of a few of the first cohort of residents here: https://research.google.com/teams/brain/residency/ https://research.google.com/teams/brain/residency/ See the old job posting which should hopefully explain the qualifications: https://careers.google.com/jobs#!t=jo&jid=/google/google-brain-resident-2017-start-fixed-1600-amphitheatre-pkwy-mountain-view-ca-159360005& https://careers.google.com/jobs#!t=jo&jid=/google/google-bra...
- kgc 9y agoThat XKCD feels spot on... https://xkcd.com/1838/ https://xkcd.com/1838/
- jnwatson 9y agoThat was literally at the end of the article.
- uyoakaoma 9y agoAll the "what happened to ryan dahl" questions have been answered.
- orthoganol 9y agoInteresting to see that the Google Brain Residency isn't that much more advanced than other graduate work or fellowship programs out there. I disagree with him about needing a "Rails for deep learning," I think it's quite fine now in practice, especially since DL code is typically significantly less than a web app. A file for data pipeline, a file for your model, and a file for training and/or inference. Not sure it really needs to be much more complicated than that.
- aub3bhat 9y agoI actually strongly agree with him, In fact the progress in Deep Learning has stalled due to inefficiencies in sharing data and code between researchers. Today to replicate a study you have to spend several days downloading data, making sure all dependencies are installed etc. This is worsened by lack of standard formats for even simple things such as representing 2D bounding box on an image. People forget that the reason Deep Learning came to prominence was engineering that enabled use of GPU's (Thanks to Alex K.) and large dataset from ImageNet competition (Thanks to Fei-Fei Li). Importance of software engineering in moving the field forward is often under-appreciated. This blogpost beautifully illustrates several instances where a great implementation made it easier for researcher to speed up experimentation and lead to breakthroughs in Computer Vision. [1] I am building Deep Video Analytics which aims to become the Rail/Django/MySQL/(favorite analogy) of Visual data Analytics [2,3]. [1] http://www.computervisionblog.com/2015/01/from-feature-descriptors-to-deep.html http://www.computervisionblog.com/2015/01/from-feature-descr... [2] https://github.com/AKSHAYUBHAT/DeepVideoAnalytics/ https://github.com/AKSHAYUBHAT/DeepVideoAnalytics/ [3] http://www.deepvideoanalytics.com/ http://www.deepvideoanalytics.com/
- orthoganol 9y agoWell, my professional experience has been completely different, maybe hardcore research in images is different. At any rate isn't TF already the Rails/ magical framework of DL, in some sense?
- ericd 9y ago
- known 9y agohttp://how-old.net/ http://how-old.net/
- known 9y agohttps://how-old.net/ https://how-old.net/ has improved a lot