4 ms·
I am a co-founder of deep learning startup - https://tensorflight.com https://tensorflight.com. Engineers without PhD, but some deep learning experience, are us
by kozikow 10y ago
I am a co-founder of deep learning startup - https://tensorflight.com https://tensorflight.com. Engineers without PhD, but some deep learning experience, are useful on applied deep learning teams like ours. Please get in touch at kozikow@tensorflight.com.
Training model itself takes maybe 10-20% of overall engineering effort. You need to have at least one person on the team, who grinded their teeth on training deep learning models. My co-founder says at least half a year of full time experience. I would say that there is nothing that would fundamentally require the PhD, just that very few people without the PhD have the sufficient experience right now. What's the most important is an intuition what method will help the most in your situation.
Within model training there are many tasks that can be off-loaded to someone without heavy deep learning expertise - e.g. data augmentation or evaluation statistics. Someone with deep learning experience is still required to know which tasks will have the highest impact.
Except the model training there is lots of work on everything around it. Inference pipeline, web server, data gathering, hardware. Majority is "plain engineering", but there is a few engineering skills specific to deep learning - e.g. inference pipeline or hardware to train models. What's more, even within the domain like computer vision, "classic" methods are sometimes still more cost effective than deep learning.
- searine 10y ago>What's the most important is an intuition what method will help the most in your situation. A PhD doesn't teach you a method, it teaches you this. That intuition comes from years of specialized training that no crash-course or bootcamp can teach.
- kozikow 10y ago"deep learning bootcamp" wouldn't be sufficient. On the other hand, training deep learning models was very different world two years ago. From a few examples in the field I know of, someone reasonably talented with decent math fundamentals can catch up with the state of the art in 6-12 months.
- searine 10y ago>someone reasonably talented with decent math fundamentals can catch up with the state of the art in 6-12 months. Being able to parrot what is known, is far far far different from being able to ask what comes next. I am talking about the training it takes to develop a critical and creative mind that can ask and answer novel questions.
- alimw 10y agocut their teeth! I'm surprised there are hardly any PhDs specifically in "deep learning", given the youth of the term. Would a PhD in some related area of statistics count for something?