3 ms·
i don't understand the concept of needing a specific amount of performance in a supercomputer to do research. You go to publication with the system you have.
by dekhn 4y ago
i don't understand the concept of needing a specific amount of performance in a supercomputer to do research. You go to publication with the system you have. I;m sure some researcher calculated that if they had X more resources, their simulation would be able discover new things in regime Y, but you know what? Often computer scientists find ways to solve problems that traditionally required a supercomputer- but can be solved on a desktop.
Chasing larger supercomputers is a folly, one we do to remain visually competitive with other countries who want to take the US's crown. But they benefit very few while costing a lot- not a good investment except for problems like "I need my submarine to be 5% more streamlined to remain competitive".
- Katydid 4y agoGood question. It's because some extreme scale computer science and application work can only be valid with the high core counts/networking available on what is now just one single supercomputer in the U.S. - That machine is now booked, leaving many unable to complete research or have to wait until 2024. Some research can only be done with that scope of system, and people have been waiting years to test exascale software on this machine. I hope this answers the question.
- dekhn 4y agoI question your fundamental premise. For example, I used to use supercomputers to run molecular dynamics simulations. When I found that the supercomputer folks didn't want me to run codes (because at the time, AMBER didn't scale to the largest supercomputers) on their machines, I moved to cloud and grid computing and then built a system to use all of Google's idle cycles to run MD. We achieved our scientific mission without a supercomputer! In the meantime, AMBER was improved to scale on large machines, which "justifies" running it on supercomputers (the argument being that if you spend 15% of the cost of the machine on interconnect, the code better use the interconnect well to scale, but can't be embarassingly parallel). I've seen scientists who are captive to the supercomputer-industrial complex and it's not that they need this specialized tool to answer a question definitively. It's to run sims to write the next paper and then wait for the next supercomputer. Your cart is pushing the horse.
- saltcured 4y agoYou know the term "embarrassingly parallel" but you seem to ignore that this term exits because there are other classes of problem which lack this characteristic. Quite a few important problems are heavily dependent on interconnects, e.g. large-scale fluid dynamics and simulations that are coupled with such dynamics: aerodynamics, acoustics, combustion, weather and climate, oceanographic, seismic, astrophysics and nuclear. A primary component of the simulation is fast wavefronts that propagate globally through the distributed scalar and/or vector fields. As long as there is a future where computers are growing to increase the scope, fidelity, and speed of these applications, there is also a need for infrastructure research to validate or develop new methods to target these new platforms. There are categories of grants that are written to a roadmap, with interlocking deliverables between contracts. These researchers do not have the luxury to only propose work that can be done with COTS materials already in the marketplace. And conversely, if your application just needs a lot of compute and doesn't need the other expensive communication and IO aspects of these new, leading-edge machines, it _does_ make sense that your work get redirected to other less expensive machines for high-throughput computing. This is evidence of the research funding apparatus working well to manage resources, not evidence of mismanagement or waste.
- dekhn 4y agoOne thing I've learned is that even when folks think their problem can only be solved in a particular way (fast interconnect to implement the underlying physics) there is almost always another way, that is cheaper and solves the problem, mainly by applying cleverer ideas. I'll give (yet another) AMBER example. At some point in the past AMBER really only scaled on fast interconnects. But then somebody realized the data being passed around could be compressed before transmit and then decompressed on the other end- all faster than it could be sent over the wire. Once the code was rewritten, the resulting engine scaled better- on all platforms, including ones that had wimply (switched gigabit) interconnect. It reduced the cost of doing the same experiments significantly, by making it possible to run identical problems on less/cheaper hardware. Second- I really do know a fair amount in this field, having worked on both AMBER on supercomputers (with strong scaling) and Folding@Home (which explicitly demonstrated that many protein folding problems never needed a "supercomputer").
- TheBigSalad 4y agoThis is an odd take. Do we even need 6GHz CPUs or should we be content to stay with 500MHz and better algorithms? There's a limit to what algorithmic improvements can do and improving algorithms is hard. If I had a 6,000 core 60THz computer I could make use of it.
- thfuran 4y ago500 MHz? Don't be ridiculous. I had 75 MHz when I was a kid and it was enough.
- madmax96 4y agoIt's not necessarily about the machine's raw performance, but capacity. The compute is a shared utility, and the utilization of supercomputer is quite high. We expect science to grow exponentially. So, compute demand grows exponentially too. The cloud is crazy expensive compared to supercomputing -- you don't want missing compute to hold back research.
- dekhn 4y agoIf science grows exponentially (rather than linearly or sublinearly), you're screwed. I don't think the cloud is expensive compared to supercomputing- so long as you consider TCO and you're doing proper deal negotiation. I would much rather than an evergreen cluster in the cloud with fast interconnect that I turn on for myself and shutdown when I'm done, than share some resource and try to keep utilization high.