4 ms·
Oh goodness. I usually hit HN in the am as I scan for news feeds and such. Didn’t expect to see my tweet here. This was written for my followers on Twitter, m
by nicohem 4y ago
Oh goodness.
I usually hit HN in the am as I scan for news feeds and such. Didn’t expect to see my tweet here.
This was written for my followers on Twitter, most of whom are in supercomputing. I understand how it might seem a bit over the top to anyone outside of HPC, but let me explain why I wrote it (not expecting it would have more mainstream views).
People in supercomputing already know what I’m talking about so I didn’t give context.
I’m glad some of the respondents here provided good background on the extended delays and the impact.
The thread was written because a few months ago after a researcher let me know her work would not be completed since it hinged on Aurora’s completion. With Frontier (at Oak Ridge National Lab) oversubscribed, she can’t finish her work and her immigration status is in jeopardy.
I felt badly for her but figured it was a one-off. Then I started to talking to more and more people. I never really connected the employment/post-doc/early career HPC researcher with problems with a machine.
The employment and research and academic ‘economy’ around big systems like this is real. Even though by 2021 everyone figured the system wouldn’t be ready by target, it still created a mess. I talked to more, then more people about what the delay meant for their careers.
They were all terrified to say anything publicly. Argonne’s under strict NDA and so is everyone else. Further, everyone was worried about losing funding or “being problematic”
Since I’m not beholden to NDAs and have the freedom to say tough things about big companies and institutions I did. I did it so the people in the same boat as the people I talked to know that their career-jerking issues have been publicly noted. I considered a more formal article for TNP but it didn’t feel like a fit.
What really pushed me to write the thread was all the hype around Intel Innovation this week. They dropped the ball over and over again in HPC since 2017. They hurt people’s careers with these delays. Yet to see them celebrate shipping of a processor that is so far behind (as were the promised ones before it that were to comprise Aurora) and to talk about zettascale ambitions when they have struggled to get a single machine out four years late. It just needed to be called out.
I wanted people to see also that processor delays affect far more than server roadmaps.
And yes, I understand semiconductor delivery and how difficult and unpredictable it is. It was the lack of transparency and the painfully awkward way NO ONE talked about it. Except most journalists who mentioned it offhand but didn't fully express what was at stake in terms of people costs.
So while I’m kind of horrified the tweet for HPC people took off, the positive side of it is that people might think about it this more deeply when they hear “processor X has been delayed” because for comp sci and application domain scientists, the career disruption can be (and should be communicated as) dramatic.
I have a pretty packed workday but can check in and answer/give more context as I have time/can.
Thanks
N
- newaccount2021 4y ago
- helf 4y agoHype is hype. It’s blows that they over promised and got bit by it. And others being bit by it also blows. But betting your academic and professional career in the promises of a third party company, /especially a semiconductor one/, is naive at best and stupid at worst. Claiming “Intel failed science” is the worst kind of dramatic hyperbole. Also, this whole idea that some people can’t finish their post docs etc because the computer isn’t ready wreaks of poor planning on their part simply because they were never guaranteed that their project would even properly run/work/scale/whatever on the new system without potentially years more of work.
- Katydid 4y agoThis is why I wish this thread hadn't gone more mainstream. It's nuanced and specific to how things work for researchers at labs. I do not expect non-HPC folks to get why it is a big deal and why the strong language was needed. Intel failed the science community in the U.S. that relies on the limited systems large enough to handle the very few applications that consume massive numbers of cores/parallelism. That's not the whole of science, but this system was central to some of the grandest-scale problem solving that exists (think planet-scale climate simulations in high resolution). I respect your opinion but my opinion wasn't for you. It was for the HPC comm.
- dekhn 4y agoYou know that many of us here are HPC folks who know the nuances... and simply disagree? I mean, sure, I don't think Intel should have taken the contract or gotten any positive PR for this, but at the fundamental level, many people on this site did supercomputing and HPC at national labs or universities, and now work on machine learning HPC on the cloud. My experience spanning both makes me think that chasing time on the fastest supercomputers is not the best way for scientists to be productive.
- 11101010001100 4y ago