8 ms·
How I turned seemingly 'failed' experiments into a successful PhD
- prashp 2y agoThis is just a regular PhD experience, but the author has made it sound like some special sort of skill only they and a few others know how to master. Everyone has to turn failed experiments into a successful PhD because they have to finish and graduate by the time funding runs out.
- JadeNB 2y ago> This is just a regular PhD experience, but the author has made it sound like some special sort of skill only they and a few others know how to master. Making a regular experience sound like a special sort of skill only you have is itself a special sort of skill that it's valuable to have if you want to apply for grants.
- authorfly 2y agoHow do you effectively apply to PhD grants, is it different to winning say Startup / Innovation grants?
- JadeNB 2y ago> How do you effectively apply to PhD grants, is it different to winning say Startup / Innovation grants? I'm afraid that I don't have the faintest idea, both because my grant activity hasn't been noticably effective (and I held no grants while pursuing my Ph.D.), and because I've never applied for a Startup / Innovation grant.
- deleted 2y ago[deleted]
- nxobject 2y agoI don’t think she’s saying “only _I_ can do this!!” - it just read to me like a “this is a what happened and what I learned from it”. Actually, I think I’ll send this article to my high school physics teacher - he was a good mentor, and he might enjoy giving it to his students.
- vikramkr 2y agoThat's not really true. They don't have to finish and graduate by the time funding runs out - nearly half of students simply fail to graduate (in the us). It's also extra untrue because this author is describing running into a null result and turning that into a PHD when usually null results don't go anywhere, either to a thesis or a publication. But it becomes true again in the context that the null result is nice framing for this article but isn't the framing in the intro/contents of the thesis. And also because: "A turning point came when another graduate student suggested a dramatic change to my protocol. I was skeptical, but I thought it was worth a shot. It turned out they were correct: After trying yet another experiment, the results started to look better—and after a few more changes, I eventually got the protocol to work. " doesn't sound like a failed experiment to me!
- glitchc 2y agoPhDs are more about perseverance than anything else, as highlighted in this story.
- vikramkr 2y agowell, also luck. Plenty of people have a PI change which can be devastating especially on a visa, or wouldn't have gotten the recommendation for the other protocol to get it to work, and also for the current crop - giant global pandemic shutting down all the labs - did you pick a topic that's essential research/not lab based? And strategy. If you chose a field based on passion instead of practical considerations like grant availability - life might be more complex in infectious disease research than in oncology lol. And academia politics. Though for some obviously politics is a plus
- deleted 2y ago[deleted]
- authorfly 2y agoCan you explain how you would determine or know about grant availability? Especially that "life might be more complex in infectious disease research than in oncology" - as an outsider this really caught my interest, I'd have imagined the two have similar levels of grants? Maybe more than a field like Psychology or Developmental Biology, about the same? Does this mean more people are going into in disease research because A) it's more interesting to them? (vs Oncology)... or B) The grants from COVID mean it's a better field?
- peppertree 2y agoI don't think the author was trying to position herself as "special". It's a pretty universal experience to try something unkonwn and feeling like a failure. I think the author is trying to convey that it's ok to feel that way.
- mihaaly 2y agoWhy a failed experiment needs to be turned into success? The outcome of the research (experiment) could be both success and failure, right? That's why we study it, experiment with it, we do not know it yet, we want to see if it is as believed or not. The important is to grow the body of knowledge here - and knowing if something does not work the way we thought will is knowledge -, not to pretend being successful, right? For pretending there are countless other (much much better paying) occupations anyway.
- gus_massa 2y agoIt's too easy to get unsuccesful results. (Does listening to Macarena for 8 hours per day cure brain cancer in mice?) So unsuccesful results are very difficult to publish and to be the base of a thesis. So you must find a twist or secondary result and make it the central part. (Does listening to Macarena for 8 hours per day cause brain damage in mice?)
- mihaaly 2y agoThat's true. Also, I think I seen that Macarena article. : ) It suggested to extend the research to primates and Spice Girls and finding songs that cure the damage of Macarena.
- deleted 2y ago[deleted]
- ericmcer 2y agoAgree this seems like basic things you would figure out doing anything uncertain. The first blocked out quote of the article is: “If an experiment doesn’t go as expected, it doesn’t necessarily mean you did something wrong.” That’s why it's called an experiment… I don’t get why this is insightful. I guess there is a lesson about carefully noting down failures, in the corporate world handing over a document detailing all the things you tried that failed is much better than just failing silently.
- zik 2y agoIn biochem results aren't "success" or "fail", they're more like "probably success" and "either fail or experimental error". And in research the vast majority of results are in the latter category so it can be hard to discriminate between failures of your hypothesis and failures in your experimental method.
- IvyMike 2y agoIf you're curious, here's her PhD thesis. (It's dual-language German/English): https://publishup.uni-potsdam.de/opus4-ubp/frontdoor/deliver/index/docId/61278/file/pramanik_diss.pdf https://publishup.uni-potsdam.de/opus4-ubp/frontdoor/deliver...
- flobosg 2y agoOnly the abstract/Zusammenfassung is dual-language, as it is usual with German dissertations written in English.
- lqet 2y agoYou really shouldn't start a PhD without doing the PhD simulator first [0]. Sadly, people who haven't yet been through the PhD experience think that this game is exaggerating for comic effect. It really isn't. [0] https://research.wmz.ninja/projects/phd/index.html https://research.wmz.ninja/projects/phd/index.html
- senkora 2y agoDiscussed on HN here: https://news.ycombinator.com/item?id=36597534 https://news.ycombinator.com/item?id=36597534
- SubiculumCode 2y agoits more amusing than accurate, IMO
- lamename 2y agoIn all seriousness, I think you're lucky then. (I can only speak for my experience and those of my peers in my field, at the end of the day)
- IshKebab 2y agoI agree, but my estimate 90% of my peers' PhDs (including mine) were essentially 3 years of work on an idea that did not work, or trying and failing to find an idea that did work. Then writing up your work as if it was great. The 10% of "successful" PhDs were on ideas that were almost guaranteed to work - more development than research. This was in a proper hard engineering field though. I think in other fields can be much more likely to be things that can't really fail. For example in computer science, a lot of PhDs are just like "I implemented this thing" where there's very little risk of it simply not working. An exception in computing is AI research where it is very much like the "try some stuff; it didn't work" experience of engineering and science research. I imagine a PhD in AI is not a fun experience...
- XorNot 2y ago
- mturmon 2y agoThis column, which appears as the last page in the print magazine, is generally pretty good and often fun to read (https://www.science.org/topic/careers-overline/working-life https://www.science.org/topic/careers-overline/working-life). IIRC the stories never end on a down note (perhaps not true to life). But, taken as a whole, they offer some ways out of the single-track-grindset that some people in the academic system have -- and that the system promotes. It turns out that there are a lot of stories out there of people who had to give up on something, change fields, recognize their strengths or weaknesses, etc. People don't talk about this stuff as much as they should.
- webel0 2y agoI would be interested to hear more about how much they were discussing their failures/challenges with others. It sounds like this might be a case of, "I finally talked to someone about it and they unblocked me in an hour." When I was in grad school I was very hesitant to ask others for help or feedback. Big mistake! I see similar things with interns: they'll wait until a daily or weekly check-in to raise problems. My approach now is to set a time budget; if I don't figure it out myself within X hours, then I have to ask someone for help.
- mihaaly 2y agoIt was refreshing to read. A research world producing (publishing) mostly success and breakthrough is not creadible anyway. I belive this improves the reputation of the academic world too.
- groos 2y agoI think the real takeaway is that collaborating/bouncing ideas off other people is the most important part of research. Few people can work isolated on their own without idea exchange.
- eleveriven 2y agoTotally agree, collaboration and the exchange of ideas are fundamental to successful research.
- pfisherman 2y agoNice story about perseverance. But I do not know how helpful this is to young researchers. My advice for young researchers is read more articles - like at least a solid month of reading and journaling full time (40 hrs per week) before you even start to think about what you want to start off with by replicating. The other related mistake I see young researchers make a lot is not leveraging pre-existing work / results and wasting weeks or months reinventing the wheel.
- ash-ali 2y agoI love this advice. But, I find it extremely difficult to just read and jot things down without having any applied work in parallel. Your idea may be the ideal case :]
- fooker 2y agoThis is very useful for laboratory science but not too much for computer science research for example. You can typically make nice prototypes in a weekend and try out ideas. If one or two of these work out, you get a paper after a bit more work polishing it. Of course you have to be competent and able to build prototypes, which is something I have seen about half of the students lack. In that case, you can typically also get a PhD by basically doing minor tweaks on existing tools and putting a lot more effort in benchmarking and story telling. Both are useful to science.
- sheepscreek 2y ago7 years and a few months for me. I guess I’m not cut out for a PhD :)
- aaron695 2y ago[dead]
- BeetleB 2y agoI don't think a lot of commenters here have realized that the author was doing a PhD in Europe, not the US. The dynamics are very different. In many European countries, you have funding for only 3 years. You either finish or you're out (typically no coursework, though). I've known cases where after 3 years they simply lose access to the buildings. As a result, the criteria for graduation is often softer than in the US.
- rusticpenn 2y agoIts in Germany, here an engineering PhD on average takes 5 years not including masters.
- myworkinisgood 2y agoYeah, but science PhD is 3 years.
- kmmlng 2y agoIt's very variable. 3 years is going to be the shortest duration, but it can be much longer.
- _Wintermute 2y ago> As a result, the criteria for graduation is often softer than in the US. Also bear in mind in Europe you need a masters before entering a PhD program (or significant research experience), and you spend 100% of your time on your research, there's not courses or teaching. I think that better explains why they're finished in 3-4 years.
- pas 2y ago> not courses or teaching That's not true for maths at U of Tromso nor true for (as far as I know) all of Hungary.
- petters 2y ago"Europe" is not a useful description of the location in this case. There are too many differences between countries, universities and even faculties within universities
- COGlory 2y agoThis is why you have more than one project. And also backup projects for those projects. Every mature lab should have a simple turn the crank project for each student that's got the biochemistry worked out, and is just a matter of collecting observations and doing lengthy data analysis. Those are the lifesavers when the ambitious ones fall through. I must have been involved in ~20 projects in my PhD. Only 3-4 will ever be published.
- refurb 2y agoExactly. Every lab usually has a few “I’ll bet it’ll work but I don’t have time to find out” projects. But that’s actually a big part of doing independent research - using your time the most efficiently, so students need to get to the point where they have a dozen or so paths and they plan out the next year or two thinking about the best way to tackle them and “fail fast”.
- j_bum 2y agoThis exactly. I filled hundreds of pages of behavioral data during my PhD. Although I don’t know the exact numbers, I’d wager that my publications came from only 20-25 pages of data. If you anticipate low success rates, you can find success either through luck or through diligent experimentation with an expectation of null results. Null results which, by the way, can often improve your odds of downstream success.
- ccppurcell 2y agoSomeone should sit every new PhD student down and explain to them that the goal isn't (or shouldn't be) getting publications or making an impact or getting a credential or a job. Of course you have to keep an eye on those things for practical reasons, but you can't lose sight of the goal which is to improve your understanding. Not even "our" understanding, just your own. If you pursue that and have a bit of talent (and luck) you will eventually push your understanding past that of the community on a given topic and you will write it up so that they may improve their understanding by reading your work.
- 3abiton 2y agoI wish this was clear to me before jumping into that ship. Fast forward few years later, I wish I knew.
- myworkinisgood 2y agoTell that to the advisors
- flobosg 2y ago> Basically, I’m not interested in doing research and I never have been, I’m interested in understanding, which is quite a different thing. ―David Blackwell
- asgerhb 2y agoMy goal is explicitly to publish, and I have the impression this is the case on a national level.
- caddemon 2y agoThat's certainly the systemic pressure. And it's hard to avoid having that approach as a postdoc. I think PhD students, especially in the first couple years, can benefit in the long term from OC's advice if they have a supportive department. Even if the long term goal is an academic career, but perhaps moreso if not. Faculty like to think of PhD students as employees but really they are trainees, and the primary goal should be strong capability to do good independent research by the end of the program. Immediately pushing for pubs is often not the best way to gain an independent research vision.
- cameldrv 2y agoThis is also a recipe for successful companies. Start/work at a company, notice some adjacent problem you have to do in the course of the work that is annoying/difficult/error prone, smooth out the problem and turn that into a new product.
- ghaff 2y agoFortunately I was just doing a Masters so the fact that my thesis (in Material Science) ended up mostly just being some basic characterization of an alloy (grain growth, hardness, Xray crystallography) didn't really matter. It was sort of a dead-end and my thesis advisor shortly thereafter dropped research in the area to focus on his other interest where he was very successful (water ice). Things would probably have been a lot uglier had it been a PhD.
- dhosek 2y agoThere was a story recently on Science Friday about journals beginning to publish results of experiments that did not prove the hypothesis: https://www.sciencefriday.com/segments/journal-of-trial-error-publishing-negative-results/ https://www.sciencefriday.com/segments/journal-of-trial-erro... They make a good point: By focusing only on positive results in publication, there is little common knowledge of pathways that don’t succeed. Back when I was doing grad studies in math, I remember thinking that this could be a useful thing in that field as well: compiling plausible pathways towards proving theorems that end up to be dead ends. I almost feel like something like this could in its own way spark new discoveries in mathematics.
- physicsguy 2y agoI think some of this is fine, but doesn’t match the pressure people put on themselves in Europe, and the expectations people put are put under in the US. For me in the U.K. there were 7 chapters to my thesis that I worked on for roughly 3.5 years. Two of those were “failures” in that they weren’t publishable as positive results but the others worked OK. One was an algorithm paper and I published the source code to GitHub because while it wasn’t useful to me (slower than the competing algorithm we already used) it was applicable in more general situations and it has proved to be so as people have emailed me about it at various times and it’s been cited.
- jameshush 2y agoGenuine question: What's the motivation for getting a PhD in an engineering field? I’m guessing you just really really love researching and have enough money/low enough lifestyle to take the oppertunity cost financial hit of not working in industry for five years?
- rekabis 2y agoThe mistake that a lot of people make is that they think science is all about proving things. In actuality, science done right is all about disproving things. You can spend a lifetime tracking down all the white swans to “prove” that “all swans are white”, but you need to find only one black swan - as the British did when they reached Australia - to disprove that hypothesis. Science is about disproving things, as it is by far the easier path - and frequently, the only possible path - to take. And by disproving things, we push back the darkness more and more, until what little remains must contain the truth. And when science “changes it’s mind”, it’s simply science obtaining more data that points better towards that truth, more of the darkness has been pushed back and the old position was eliminated by the new evidence.