6 ms·
NOAA kicks off 2018 with massive supercomputer upgrade
- pinewurst 9y agoIt's interesting that Dell won this one. Sadly there's not a lot of technical info about the system itself or the big storage expansion (probably more Lustre, sadly - my tax dollars at work).
- SEJeff 9y agoBut would GPFS really be any better? What other competition is there for big iron hpc distributed storage?
- pinewurst 9y agoLustre nominally scales higher than GPFS, but GPFS is more reliable and better performing for anything having to do with metadata. It's also a lot more expensive license-wise. There's other competition, but it's not proven at these scale levels. Top 500 deals are bad business so it's not really worth it to develop/test for them thus leaving the business to the incumbents (e.g. the dumpster fire that's IBM or the Arkham Asylum that's Lustre).
- SEJeff 9y agoFYI I work directly with the amazing guy who wrote this: https://csc.fi/web/blog/post/-/blogs/the-largest-unplanned-outage-in-years-and-how-we-survived-it https://csc.fi/web/blog/post/-/blogs/the-largest-unplanned-o... Lustre at scale is a disaster, but one you can pay for people to help you with. GPFS is unbelievably expensive, but is a lot more reliable wrt metadata, but it is also quite fragile. In my original question, I mean other than the obvious one of Lustre.
- labster 9y agoI'm sure the GFS model will be better with a faster computer. We can get more ensemble runs, at the very least.
- SEJeff 9y agoI was referring to GPFS as in IBM's commercial General Parallel FileSystem, not the Global Forecast System.
- dokument 9y agoDidn't Dell acquire EMC?
- pinewurst 9y agoYes, but EMC doesn't do that level of storage. For HPC, Dell resells various hodgepodges of their servers running Lustre (or rarely GPFS) with JBOD or cheesy RAID for the disks themselves.
- vonmoltke 9y agoTo be fair, the post is not clear in whether Dell is supplying the storage as well. NOAA may be adding SAN storage from a place like DDN.
- SEJeff 9y agoAnd DDN would still not be enough. DDN would be paired with something such as Lustre or IBM's GPFS to run the storage for big iron such as this.
- vonmoltke 9y agoI understand that, because those are basically the only filesystems anyone could use for this application. The comment was aimed at the "various hodgepodges of their servers ... with JBOD or cheesy RAID for the disks themselves" part.
- InclinedPlane 9y agoIsilon is part of EMC which is part of Dell (now). They do scale-out fault tolerant storage up to multi-petabytes.
- pinewurst 9y agoBut Isilon is purely NFS (and/or SMB/CIFS) and doesn't support the parallel access that GPFS or Lustre do. It's not really a choice for this workload. Plus it'd be a lot more expensive than HPC storage - enterprise level RAS (reliability, serviceability, availability) costs. I've seen comparable capacity Isilon & DDN quotes (w/GPFS or Lustre) and they're worlds apart.
- sigmar 9y agoThe GFS model has been embarrassingly bad in comparison to Europe's ECMWF models. Here's to hoping it will be more competitive in 2019.
- sliverstorm 9y agoHas there been a rash of failures? Not a meteorologist, but I usually hear that ECMWF & GFS have generally been trading blows, and have different strengths.
- brootstrap 9y agothere are a few high profile cases where the Euro predicted hurricane paths better then the GFS. Granted these hurricanes are HUGE events and better hurricane forecasts saves lives etc. However these models predict ALL the weather, all the time, not just hurricanes. We use the GFS (in combination with other models as well) to shape our forecasts every day for all kinds of weather and millions across the country rely on these data. The guy reading you a forecast on news channel ? If they are providing a forecast for greater than 3 days in the future, you bet they are including the GFS info in their predictions!
- deleted 9y ago[deleted]
- brootstrap 9y agoembarrassingly bad according to what? At my work we use the GFS data and our customers are extremely pleased with the data we provide.
- labster 9y agoThe GFS was bad at tropical weather this year. Though I have to say, the GFS has been a little less crazy in long term forecasts on the US West Coast lately. Not sure how much processing power will improve the tropical storm forecasts, though. I had the impression that had to do more with the model's physics. Though it would be nice to catch up with the ECMWF's data assimilation prowess, that would definitely help.
- spyspy 9y agoNo mention of their Gaea supercomputer at Oak Ridge. I wonder if it's still operational.
- Infernal 9y agohttp://knoxblogs.com/atomiccity/2016/04/28/noaas-supercomputer-upgraded/ http://knoxblogs.com/atomiccity/2016/04/28/noaas-supercomput... Looks like they shut it down April 2016.
- t-brown 9y agoGaea is still up and running. The C? names are sub-components, so currently Gaea is C3. https://rdhpcs.noaa.gov/ https://rdhpcs.noaa.gov/ https://www.ncrc.gov/ https://www.ncrc.gov/
- Infernal 9y agoD'oh. I did not even completely read my own link - extra embarrassing as I sit in the same building as this cluster...
- JohnJamesRambo 9y agoSo many acronyms in this thread...I wish I knew what any of them mean.
- pinewurst 9y agoFeel free to ask for definitions!