3 ms·
Great interview. I have been trying to understand how the success of deep learning will affect my career (I started using neural networks in the 1980s: DARPA pr
by mark_l_watson 10y ago
Great interview. I have been trying to understand how the success of deep learning will affect my career (I started using neural networks in the 1980s: DARPA projects, commercial projects, etc., but now less that 1/2 of my professional time is spent doing deep learning and General machine learning). I am trying to decide whether to toatally jump back into the field to take advantage of a lot of practical work experience, or keep doing general consulting. I am concerned that the field of deep learning is saturated right now.
One small nit-pick about the comment "a young child can see a chicken once, and if you then ask them to draw a chicken, they’ll typically be able to. The child has a representation of a chicken from one sighting, and is able to abstract that into a drawing." This hypothetical child watches the chicken, moves his head for a little different view, the chicken is probably moving, etc. There is a lot of training data collected by the child.
- mappingbabeljc 10y agoHiya, (I'm Jack Clark) - this is a good point. The child probably gets about 50 to several hundred distinct 'frames' of the chicken. Still, a remarkably small number of examples.
- dTal 10y agoIt would also be a terrible drawing. An adult who had seen many other types of birds would be able to do much better, as they would have learned more abstractions - for example the experience required to condense a complex visual pattern to, say, "mottled".