5 ms·
I hire machine learning engineers and data scientists. In my opinion there is a great shortage of truly qualified machine learning engineers. A lot of people ar
by hardtke 10y ago
I hire machine learning engineers and data scientists. In my opinion there is a great shortage of truly qualified machine learning engineers. A lot of people are entering the market with a general knowledge of machine learning tools. These people should be considered analysts or product data scientists. When it comes to people that can build machine learning systems that work at scale, they are very rarely available for hire and often are the subject of bidding wars by multiple companies. The key difference is whether the candidate truly understands the mathematical and statistical basis of machine learning, has the programming skills to execute their ideas, and is able to write code that can be used in large scale production systems and can be leveraged by others.
- user5994461 10y agoAnd that's why I think finance is smarter. They've long understand that there are the finance analysts on the one hand and the software dev on the other. They get both and make them work together. Looking for 5 rare skills in a single person is bound to disappointment: maths, statistics, programming, large scale systems, production.
- hardtke 10y agoCompanies that have a research division and a separate engineering team to implement the research ideas are rarely successful. Anyone engineer good enough to do the implementation will figure out they can build something better without the input of the researchers. Microsoft and Yahoo both had great research teams whose ideas rarely saw the light of day.
- user5994461 10y agoI didn't say to put them in two separate divisions. Put both guys in the same place, working closely with each other. Any engineer will quickly figure out that he's out of his depth in the maths & statistics. Any mathematician will quickly figure out that he's out of his depth in the system building.
- infinite8s 10y agoAnd this is why a lot of trading desks would couple a trader with a quant with a technologist.
- runT1ME 10y ago> The key difference is whether the candidate truly understands the mathematical and statistical basis of machine learning Can you elaborate on this, and at what level? Are you talking about a PhD level of understanding of cutting edge mathematics, or do you mean understand the basics, or somewhere in between?
- hardtke 10y agoSomewhere in between. A simple question I use is "how do I decide whether to add a feature to a classification model?" Most candidate are fine until I bring up the topic of correlated features.
- DrNuke 10y agoAre you hiring for finance? In Europe it still depends very much on the industry: some mean coding, some maths, some infrastructure, all want data preparation and in-depth stats. edit: other than understanding the business fundamentals, of course.
- akvadrako 10y agoDo you mean like non-orthogonal dimensions?
- photoJ 10y agoThat's terrible.
- shas3 10y agoI think the following interview questions can help screen candidates (not an exhaustive list): 1. Asking a candidate to cast a non-standard problem of classification or estimation into a tractable optimization problem. (this is a very valuable skill that someone who has done good studies in numerical linear algebra/machine learning/stat/information theory/control systems/signal processing/math/etc. should be able to do) 2. Asking them to take an algorithm they have used and explain every step in deriving the algorithm. (It will help interviewer calibrate the level of learning in the interviewee. Also helps screen for indisciplined black-box users.) 3. Presenting challenging machine learning scenarios: using customized ensemble learning approaches, imbalanced data sets, noisy labels, multiple instances, different error metrics, etc. and seeing how interviewee approaches the problem from first principles (real world problems almost always involve some of these issues) 4. Testing their intuitions in "feature-engineering" for different types of data. (with the partial exception of cases where rigorous research/successful products show the utility of deep learning, one has to almost necessarily do a fair bit of feature-engineering)
- notyourwork 10y agoMy colleague focused on machine learning for his phd and this is a very accurate description. Talking the talk can come with experience, being able to understand the math and execute a new system at scale is where the separation in experience will start to surface.
- gech 10y agoWhats the time from hire to a built live production system you would expect a truly qualified engineer to be able to achieve?
- IndianAstronaut 10y agoSomeone who can build models and someone who can scale it are 2 different people and professions. Data scientist vs data engineer.