14 ms·
Ask HN: Is a masters in ML worth it?
With all the new developments and AI startups, I have been considering going back to get a masters in ML/AI concentration. I have about 5 YOE in non ML software engineering but want to work for these cutting edge tech companies. Will a masters in ML give me an advantage when applying or is it not worth it?
- PaulHoule 3y agoI work close to the engineering school at a big Uni and often meet MEng students, at times in the past I had them help me out with ML projects that but usually I end up talking to them on the bus or in the 6th floor kitchen. So it's a question I ponder. I had one student who did all the coding for a successful project that we wrote a paper about. I've talked to others who feel like they are "over their head" but are working on teams with people who know how to do all the math. That might be OK because there is a lot more to successful ML projects than being an individual contributor: very few people know how to manage ML projects and if you learned something about that it could be highly valuable. If you study for a PhD you will definitely learn the math, but you've got an entirely different problem that you could be out of the workforce between 5-10 years and the market could look entirely different then than it looks now.
- lagrange77 3y ago> but you've got an entirely different problem that you could be out of the workforce between 5-10 years Do you mean because of automation?
- vineyardmike 3y agoBecause PhDs aren’t fast to acquire. It could take 5-10y to complete. And you usually can’t do a PhD part-time and continue to work.
- lagrange77 3y agoOh, i get it. I misread it as: > but you've got an entirely different problem that you could be out of the workforce in between 5-10 years
- maleldil 3y agoFWIW, this is a very US-centric view. In the UK, you will usually do an MSc + PhD in 4.5 years: 1 year for an MSc and 3.5 for a PhD. You can double that time if you want to do it part-time, in which case you can continue working.
- neofrommatrix 3y agoBecause tech moves fast. For instance, about 10 years ago, cloud was big (and it still somewhat is). I assume a lot of students dug deep and got their masters and PhDs in it. Now, there’s a lot less jobs or a lot more competition compared to then.
- PaulHoule 3y agoJust change. It is amazing how fast an academic field can "burn out", for instance the discovery of the renormalization group in physics and its application ran a lot of its course in just a few years. Similarly if you were a deep learning expert 5 years ago departments were really hiring up and you'd have an easy time continuing in academia, if you start on deep learning today it is possible there are just too many deep learning experts and not enough jobs.
- G0lg0thvn 3y ago> very few people know how to manage ML projects and if you learned something about that it could be highly valuable. Thanks for highlighting this! As someone starting to wade into the ML project management space, would you be able to share any resources on the topic that you think would be helpful?
- alexpetralia 3y agoI think it really depends on where the Masters is. I personally have noticed a lot of degree mills at the Masters level that are superficial academically and primarily designed to lure in candidates to the most profitable part of a university.
- mstaunton7 3y agoThis is one of my concerns. I don’t have ML experience and have a feeling it’s a requirement for the top universities. By the time I build up experience, the opportunity cost just continues to rise
- AnimalMuppet 3y agoToo early to tell. How long is a masters going to take? Three years? What's the ML landscape going to look like in three years? I don't know the answer. In three years, ML could have pretty much maxed out, and people could be not hiring for it any more. Or in three years a masters in ML could be the golden ticket. I don't know. I don't think anyone else knows, either. My impression is that "these cutting edge tech companies" are not easily able to find as many qualified candidates as they want right now. Emphasis on "right now". Is there something you can do to become qualified (by their definition) that will be faster than a masters? (I'm pretty sure that their definition of "qualified" has to be less than a masters - there hasn't been enough time for there to be very many ML masters degrees yet.)
- n4r9 3y agoUpvoted. The OP is specifically asking about a masters in ML. Many of the other immediate replies don't seem to have taken this into account.
- fowkswe 3y agoThis is a great point and I think the crux of it is - is ML going to be like the last crypto 'boom'? I don't think it is. Investment is being made at an institutional level in a way that was not happening for crypto. We are deep in the midst of the hype cycle right now, but if the hype pans out, ML will have a transformative effect on the tech market (or world for that matter) akin to the internet itself. In that scenario, ML expertise at any level will be a golden ticket.
- krainboltgreene 3y ago> but if the hype pans out I wonder how many times that's been said in the last 15 years on HN.
- master-lincoln 3y agoIs the ML industry different than the rest of tech I experienced so far, in that they actually care much about official certificates instead of testing your knowledge in interviews or looking at what you did already?
- Inf0s3c 3y agoI doubt it. Most places hiring want hands on experience with tech stacks; PyTorch, opencv, training, fine tuning models… concrete skills Make reference implementations from a couple recent papers, publish them on GitHub. Fine tune a demo model to show off during an interview. Thats shows you lean into the work, not memorization of academias circumlocution
- clbrmbr 3y agoThis. Degrees (other than top tier) stopped mattering a while ago but somehow many paying students haven’t noticed yet. Actually implementing methods from recent papers will give a real education and at the very least a really damn impressive portfolio, if not some notoriety on its own.
- office_drone 3y ago> Will a masters in ML give me an advantage when applying A master's will almost certainly do one or more of 1) Getting you past the resume screener and the posting's absurdly high education requirements 2) Showing that you are not dumb 3) Showing that you are willing to put in work 4) Communicating that you might actually know how to do stuff 5) Letting the hiring manager brag about hiring someone with a master's in ML instead of a bachelor's.
- candiodari 3y agoMakes you wonder ... how to break in if you have a master's in AI, but from 2007 (before the mild AI winter ~2006-2008) and have been doing systems engineering since. So how do you get a job in AI without dropping to an intern's wage?
- spmurrayzzz 3y agoAnecdotally, I'm seeing many people get hired by just building things in the wild. There's a ton of open source work going on still in the early stages, everything from inference servers to training libraries to MLOps frameworks and beyond. Being a solid contributor to any of those projects, or starting an individual project is a good start I think. (As an aside, I also think "job in AI" is a little to abstract to comment on in many ways since the term is so overloaded in 2024)
- flippy_flops 3y agoIf you feel like you have decent math chops, i would use that time and money on online training, hardware, develop a portfolio of projects that demonstrate your new skills, and make contributions to open source ML libs to pad your resume. But also, many of the new AI startups are just using ML as a service where expertise is not necessarily needed.
- dmckinno 3y agoI completed the ML specialization for Georgia Tech's online CS MS program (https://omscs.gatech.edu/ https://omscs.gatech.edu/) a few year ago and found it tremendously valuable. I can't say that it changed the trajectory of my career, but I learned a lot, met some great people, and (in hindsight) had a ton of fun. Keep in mind that most machine learning fundamentals haven't changed for decades. While new architectures/trends are always emerging, the lessons that you will take away from an academic program like OMSCS will be relevant for the rest of your career.
- ProjectArcturis 3y agoAs a data scientist, I would advise against moving from software engineering to ML. There is an enormous glut of junior DS/ML people. The boot camps and masters programs capitalized on the hype, and now there are way more than the market can absorb. Anecdotally, my recruiter spam has gone way down over the past couple years. The only worthwhile related masters degree, IMO, would be in large AI from a top-tier university.
- asynchronous 3y agoIt seems as though tech just has a junior person problem all around - this is abundantly clear in cybersecurity, where we have an overwhelming amount of people with useless bachelor’s degrees and no actual talent or experience to back it up.
- TMWNN 3y agoHow would you rate someone with a background in military cyber? (Or I wonder if you would see them at all, because defense contractors would sweep them up first?)
- asynchronous 3y agoI’m probably the outlier on this particular note, but a lot of people view ex-military folks trying to get into cyber as God’s gift to this green earth, but I actually am hypercritical of those individuals. Reason being, having worked with several military branches for many years as a contractor, some of the least innovative, most incompetent people and education I’ve seen is in the military apparatus. If they worked for the NSA or were actual operators they know their stuff of course, but those people usually don’t have problems getting placed in industry afterwords.
- spacemadness 3y agoIt’s at the point people are entering ML bootcamps that have zero interest in the science but a big interest in having a job. I have one anecdotal story about a friend of a friend doing just that.
- giantg2 3y agoMy masters in info science was not. I'd be farther in my career if I had just put in extra hours everyday instead of spending it in classes.
- TuringNYC 3y agoI did a Masters in Data Science and worthiness depends on a lot of factors. - The experience is what you make of it, how challenging a course-load you choose, etc. It is often possible to coast thru these programs by taking the easiest classes, if you just want the degree. It is also possible to really go off the deep end and learn a ton, if you want to put in major hours. - Office hours with professors made it worth-while. I utilized almost every one and grilled the profs hard with questions. I imagine you can get this for free if you work at Google/Meta/etc but I didnt have access to that type of intellectual sounding board, so the MS made a lot of sense. - Degree diversification makes sense. I had an east coast ivy league undergrad, so I wanted to balance that out with a west coast technical institution with a very different alumni base, so I chose my MS program accordingly. - The network matters. Find a Uni with a great network. - Ecosystem matters. Find a Uni with a great ecosystem of startups, accelerators, VCs, and FAANG workers who are adjunct. That limits you to Bay Area and possibly NY/Boston in the US, but I think people underestimate how valuable this is. I compared my undergrad (rural Ivy league) to grad (Bay Area) and the difference was night and day. There is just very limited ecosystem possible when the University is stuck in the mountains. - Job placement can be good or bad. Uni recruiters have their "target student profiles" whom they work with to place them at top companies. If you arent on their "target student profiles" list, they wont help you. I spoke to great students in 2021 graduating at the absolute peak of the tech hiring craze, who had been sent away by the university recruiters noting "there are no jobs now." - To learn deep ML you need to start a hard-startup and dive deep into it w/o a dayjob. I did. I did an ML/CV startup diagnostics firm focused on medical imaging. I learned more in 3yrs than I did in 10yrs in industry. I did this in parallel with the MS in DS and that would a wonderful combination because the campus had numerous benefits for students with startups. I could also run hard problems I encountered by my professors and TAs. The MS gave me theoretical knowledge and the startup forced me to truly learn things because otherwise I couldnt ship. - A small number of students (15%) were outstanding and I keep in touch with them, they made the experience worth it. - A large number of students (30% ?) were not paying anything for the degree, often it was being paid for by the US Government as part of US Gov benefits programs. I'm sure it was worth it for them. In some cases they didnt value it as much those paying out of pocket. I saw some completely free-riding and doing no work and leaving most of the effort to team members. - Ambitious projects get seen. I had many, many employers reach out and try to hire me after seeing my masters projects. But you have to learn to manage, market, document and be very vigilant with whom you work with. One free-riding student can seriously tank a major project, and you end up suffering. A cohort of equally ambitious students is unstoppable and a pleasure to work with. If you want, you are welcome to email me and I'm happy to speak to you on the phone.
- richrichie 3y agoWe have masters in ML now, wow! What do they teach apart from stats, optimization and linear algebra?
- datadrivenangel 3y agoscikit-learn and pandas. Also some stats, optimization, and linear algebra hopefully, but most of the data science degrees focus on the tools.
- fullstick 3y agoI would hope that research is a major part of a masters in ML. It is for my Cybersecurity MS which has an informal focus on ML.
- throwaway_89282 3y agoThe sad reality is that most paid Masters degrees (and even non-paid via opportunity cost) are scams that are unlikely to lead to a job.
- bunderbunder 3y agoSo, I'm guessing that the people with the most regrets about joining the California gold rush were the ones who decided to move there after 1850. It might be worth thinking about whether this is because you find machine learning interesting on a personal level, or whether you're just trying to be where the excitement is. If the AI hype has already started to cool off by the time you graduate, are you going to feel regret about the real & opportunity costs of going back to school, or would you still see it as personally rewarding and feel motivated to persevere in building a machine learning career in a slower job market? That said, if you want to get into machine learning, I've been seeing that increasingly many entry-level machine learning jobs now require a master's degree of some sort. Be aware, though, that these jobs may not be glamorous. I've go a master's degree myself, and usually see all the really exciting work get handed to colleagues with PhDs. I still find it to be a rewarding career, but that's possibly because I enjoy the work itself, and am not particularly worried about the glamor. It may also be worth pointing out, while all of my colleagues do have at least a master's degree, none of them have one in machine learning specifically. Typically it's one in some other hard or social science. Basically anything that builds a strong foundation in statistics, linear algebra, and research & experimental methodology. The actual machine learning part of the job is kind of the easy part, and mostly belongs in the top row of that "what people think I do / what I really do" meme. I did have two former colleagues who started out as software engineers and then got a master's in machine learning / data science / whatever in order to pivot to AI/ML. Both of them really struggled to settle into the work, and ended up reverting back to just being software engineers, only now with a lot more student debt.
- andoando 3y agoIts a dream of mine to get a PhD in computer science or even mathematics. I only have my undergrad in CS and 7-8 years of software engineering experience. Due to some bad decisions Im also quite broke. Im also thinking of doing a masters at georgia tech or something, or just diving in, but not really sure what to do. I just know Ill regret it if I never do it.
- dehrmann 3y ago> Its a dream of mine to get a PhD in computer science... I...have my undergrad in CS and 7-8 years of software engineering experience. You've put a PhD amount of work into industry. Unless there's a specialization you have a passion for, what are you hoping to get out of it? Or is it that you just liked school?
- andoando 3y agoTo clarify I meant Im not sure what to do in terms of how to proceed. Im near broke so ideally Id make some savings before plunging another 4-6 years with little income. I genuinely just enjoy thinking about theoretical concepts. Its the one thing I found to be a natural driver for me, where I can find myself walking in circles thinking about something days on end. Ive put an unhealthy amount of the last 3-4 years or so for example thinking about pattern composition with no practical benefit. Never wanted to work in corp in the first place, but I wasnt a super achiever back then and the money was good. I do miss school and think Id be happy learning abstract mathematics, but my real interest is in knowledge representation. On the other hand, I have little interest in tech, and even less interest in working in industry and after 8 years I can build pretty much any application and scale it to millions of users which is good enough for me. Not interested in promotions, making more money, being CTO or whatever
- dehrmann 3y agoI haven't been there, but I'm not sure how much of this you'd actually get from a PhD, and it doesn't give you an answer for what to do once you get the degree. It halfway sounds like you want to be a professor, but read some of the comments on other posts about what academia is like. It has all the politics of industry, but the lower stakes somehow make for more drama. If it's just the learning you enjoy, you can do that in your free time for free. > I can build pretty much any application and scale it to millions of users Can you build the cloud it runs on? Can you write a database? An OS? Design a motherboard? It's hard to run out of things to learn in this industry.
- netbioserror 3y agoI was in a combo program, got my Master's in ML on the way to a PhD. I really didn't quite understand academia before I entered. It got to the point where I couldn't see the light at the end of the tunnel, I had spent 4 years on a very long paper that didn't represent my own desired direction of work in the field. And the whole time I had simmering thoughts that I'd rather being building software in an engineering context, that academia was not my place. I eventually quit and did find a job with a smaller company building math-heavy analysis software for an engineering field. I'm quite happy with my choice; I pick my language and tools, I have complete agency over my part of the product stack, and I solve interesting problems. Sometimes I entertain the "what-if," but I see the ML industry as stuck in a massive bull-trap bubble, with a lot of people working on "products" that add zero value to their company's portfolio. I don't chase easy money, I chase interesting work.
- deleted 3y ago[deleted]
- reureu 3y agoAs a hiring manager in the data science/ml world in healthcare, I generally think of degree programs in "data science", "machine learning", "artificial intelligence", "deep learning", etc as being less valuable than degree programs in the corresponding fields that aren't as buzz wordy. I tend to prefer candidates from backgrounds like computer science, math, applied math, statistics, or something domain specific (coming from healthcare) like epidemiology (or variation like computational epi) or bio- or biomedical informatics. Those programs tend to show me that you're interested in and have done the more boring but foundational coursework that is often cut to make the sexy degree programs. That means that hopefully you won't be upset that 100% of your job isn't deep learning, and that you'll be better suited to pick the right tool for the job. At one of my last jobs, there was a machine learning engineering team (all boys) and a data science team (all girls and gays) who had the same ML chops. The DS team ended up getting more models into production and more research published than the ML team because they had more "soft" skills to navigate the problems the org was facing. When someone in leadership would say "we're having issues booking appointments", the ML team would set off building some fancy deep learning model while the DS team would generate hypotheses with stakeholders, do some exploratory analysis, run a few prospective studies, and then use those results to inform some regression models that would end up in production. It wasn't as sexy as some deep learning model, but the leadership team wanted full interpretability of their model so deep learning was never going to be acceptable. I generally think of these kinds of skills being taught more the stats, applied math, or epi programs than in the designer ML programs. ymmv
- melondonkey 3y agoThe cultural divide between ML engineers and “girls and gays” in data science is very real and in my experience getting worse. Good but rare when the styles can be brought together.
- garciasn 3y agoHiring leader for a DE/DS team at a Digital Marketing agency; I feel the exact same. I strongly prefer folks from non-specific degree programs who come with a desire to learn as opposed to deep experience in a program tailor made for a specific niche subject where degree candidates learned on absurdly simplistic or unrealistic data and models. The modeling itself is largely meaningless and simple to execute against. It’s the data and the insights that matter and I haven’t yet seen a niche designer masters program graduate who actually could show me a meaningful end-to-end project they were truly passionate about.
- iknownthing 3y agoIn addition to the other comments keep in mind that the number of people actually working directly with ML at these companies is much smaller than the number of people claiming to.
- currymj 3y agoa key aspect of the cutting edge companies is their ability to execute on very large and complicated software engineering projects, so you should see if your existing software engineering skills might already be useful. e.g. look at Anthropic's job postings for engineering roles -- they don't super-emphasize AI knowledge, they seem to also face a ton of classic engineering challenges. there's as much about managing cloud infrastructure and distributed systems as there is about transformers.
- seatownhack 3y agoI had a friend who started a masters in ai at uw. He really struggled with it because of the opportunity cost. He knew he was losing money and career progression by staying. He ended up dropping out.
- dver 3y agoI'll be hiring this year as well. I'm in the manufacturing domain. As said a few times below, I'm looking for real work experience. Specifically in the domain. I also agree, there is going to be a lot more really boring work, mixed in with some new and interesting. Pretty much the job description for most of the IT world.
- MrMember 3y agoI specifically pursued a master of computer science in data science to cover all of my bases. If I'm applying to a job where I want to highlight the focus in data science I can but I don't need to. My diploma just says "master of computer science" on it and in some job applications that's what I want it to be.
- from-nibly 3y agoHere's what I would look at. (This goes with any certification or degree). Does the learning experience contained within the masters degree look like it would be worth learning. If so then you can go do that learning and accidentally get a degree while you are there. If not, then you'd be participating in pay to win, a game in which the house always wins.
- protus 3y agoI work at a startup, and recently built the fraud detection algorithm we use to classify and process payments. I have a BS in CS with a minor in Data Science, and also have applied ML experience. My take is that your skills and knowledge are paramount over your degree, especially if you're building ML systems that are adding value to your company.
- listenlight 3y agoWhy not start one?
- specproc 3y agoThere are lots of high quality answers on the recruitment side here, so I'll focus on the personal. I did a masters in my mid thirties, and it was definitely the best life choice I made that decade. Education, ideally, is about learning, not career progression. I had a fantastic time being completely focused on studying. There's nothing nicer than waking up in the morning knowing that your main task for the day is reading a bunch of interesting papers. The specific course, well, that's down to you, but as a thing to do with a year or so of your life: magnificent. Lots of folks end up with kids, or without the cash, or stuck in a job for other reasons. It's fantastic to be even able to consider it. If you can, I think it's a great idea from my experience. Worst case scenario, you will grow in skills and confidence.
- taf2 3y agoIt can be totally worth it. If you put your all into it
- anbardoi 3y agoI'm stacking my chips in the study of quantum computing. It might be fruitless, it might not. I just think its really cool. Plus it feels like I'm casting a wide net. If quantum does become more practical, what is every tech company in the world going to gravitate to, no matter their field?