9 ms·
Supercomputers for Weather Forecasting Have Come a Long Way
- Retric 10y agoIt seems like weather forecasting has actually gotten really good over the last 30 years, except for snow. Are there any good statistics for relative accuracy out say 1-3 days?
- rm_-rf_slash 10y agoComing from upstate New York, I have accepted the longtime reality that the weather will always be shittier than expected, so we pack according to probable shittiness instead of expected forecast. My girlfriend is from Florida, and even after three years of living here she is still unused to the habit of keeping ice scrapers, umbrellas, rain boots and an extra jacket in the car at all times.
- madenine 10y ago"Welcome to Syracuse, where the seasons don't matter and the weather is made up" Upstate weather is a mystery. When I was in school we had 80 degree weather towards the end of the spring semester before a small snowfall the day before graduation.
- gingerbread-man 10y agoA one-day temperature forecast is now typically accurate within about two to 2.5 degrees, according to National Weather Service data. https://www.washingtonpost.com/opinions/five-myths-about-weather-forecasting/2015/01/02/e49e8950-8b86-11e4-a085-34e9b9f09a58_story.html https://www.washingtonpost.com/opinions/five-myths-about-wea...
- Afforess 10y agoWeather forecast accuracy is a statistic anyone can measure and generate. Put the forecasts and the actual weather outcome together in a spreadsheet, examine the results each day for the 1,3, and 5 day forecasts. NOAA and the UK Met Office both do this for all of their forecasts, it's called "verification", and they measure their forecasting bias. In general, the statistics I've seen suggest the 1 day forecasts are 95% accurate, 3 day forecasts are ~80% accurate, and 5 day forecasts are ~70% accurate. This may vary if you live in a hard to forecast area. For example, surface temperature forecast verification for Jan 2017: http://www.mdl.nws.noaa.gov/~verification/ndfd/index.php?mo_id=201701&ty_id=pt&rr_id=ptreray&re_id=co&wx_id=tt&pr_id=003&md_id=nd&mr_id=Array&cy_id=00&pd_id=ma http://www.mdl.nws.noaa.gov/~verification/ndfd/index.php?mo_...
- philippnagel 10y agoWhat constitutes a hard to forecast area? Any examples?
- Afforess 10y agoSure. The most challenging areas to forecast are typically areas with poor data availability (Mountains) or with topological features that impact the weather significantly (Great Lakes affect winter forecasts significantly). I imagine the Rocky Mountains and Great Lakes region both have lower than average forecast accuracy.
- ghaff 10y agoA lot of variability in weather. Multiple weather systems tending to come together. It's a lot harder to forecast Boston than it is Las Vegas. It also depends what you're trying to forecast. If you live in a very dry area, you're going to be right about precipitation the vast bulk of the time.
- pkaye 10y agoI've always wondered why so many weather websites make it hard to compare actual vs predicted weather forecasts for historical data.
- Cyphase 10y agoPossibly they don't want to make it easy to determine their accuracy rate.
- angry_octet 10y agoPeople are always happier being grumpy and ignorant than informed and accepting.
- Retric 10y agoThat does not seem like a great way to test for accuracy. ed: as described. I can predict Hawaii's temperatures out 20 years based on historical data much better than Chicago's. So some adjustment for area variability should be accounted for. People also care a lot more based on how off the temperatures are. So, being off by 5 degrees every day is better than being off by 1 degree for 4 days then 20 for the 5th. I assume there is some adjustments for this stuff?
- ghaff 10y agoIn general, precipitation seems to be one of the tougher areas, especially as it can be very localized. With snow, you then also throw in rain/snow lines which, where I live in New England, are very commonly somewhere within the greater Metro area. But in the big picture sense, and for things like hurricanes, forecasting has improved a lot. It's unlikely we'd be caught by surprise today as happened with the Blizzard of '78 when massive numbers of cars got stuck on the highway and had to be abandoned or people were stuck at their offices for a week. (The weather events still occur of course but they're less likely to catch people unprepared.)
- bluedino 10y agoThat happened in Chicago in 2011 - a blizzard caused hundreds of cars to get stuck on South Shore Drive. I'm not sure if it wasn't warned or people were just stubborn.
- ghaff 10y ago>or people were just stubborn It's probably less true than it used to be but, for years, a lot of people in Boston were really paranoid about big snow storms. Everyone knew someone or at least knew someone who knew someone who had be evacuated from Route 128 or slept in their office for a week. About a decade later a friend of mine moved to Boston and she once told me that she had never seen a northern city where people took off home from work at the first snowflake the way they did in the Boston area.
- mikeash 10y agoIt can be pretty amazing. I subscribe to a specialized forecasting service for glider flying, which takes the output from the big models and uses it to derive parameters useful for flying. I remember flying on one day when the forecast said that I'd be able to climb to 3,000ft in one spot, and to 6,000ft in another spot only about five miles away. In the air, I tried the first spot because it looked better to me. I topped out at 3,000ft. I moved over to the second spot and sure enough, 6,000ft. It was pretty amazing how good that one was.
- endersshadow 10y agoSo snow is super hard to forecast because snow bands. These happen at a mesoscale, and typically one 1-2 grid points of the models used to forecast. The exact processes that contribute to banding are not very well measured, either, so it's very difficult to get a good prediction for it. Due to the banding, you can get extreme variations in snowfall, leading to, "I thought we were supposed to get a foot, but we only got an inch!" type of comments. Or, bands will line up with the storm motion and just pelt an area harder than expected. Example: http://imgur.com/i0j4I7g http://imgur.com/i0j4I7g
- knz 10y agoThe Updraft blog by Minnesota Public Radio just had a small piece about how the various weather models change and what that means for local snowfall. http://blogs.mprnews.org/updraft/2017/02/snowcover-view-from-space-forecast-model-review/ http://blogs.mprnews.org/updraft/2017/02/snowcover-view-from... - under "GFS model shifted". They do similar articles semi regularly.
- gbrown_ 10y agoCurrently the most powerful weather forecasting computer is the UK Met Office machine, a Cray XC40 machine that delivers 6.8 petaflops and sits at number 11 on the TOP500. But this does not run the production forecast, that is done on one of two smaller machines which are capable just over 3 petaflops. Source: I work for Cray at the UK Met Office.
- gingerbread-man 10y agoSo the XC40 is used for research purposes? I'd be very interested to know more about your workflow.
- gbrown_ 10y agoThat XC40 system is for collaboration work but it also serves as a test bed of sorts as it's so much lager users can try scaling up models on it.
- onion2k 10y agoWhat does it do then?
- NLips 10y agoPlease can you tell us what forecasts it is running then?
- deleted 10y ago[deleted]
- alex_hitchins 10y agoWhat is the 'bigger' one used for then? Edit : Answered while I was posting this
- popobobo 10y agoIs it running fortran? Which version?
- Odenwaelder 10y agoHere's a great (paywalled) Review on numerical weather forecasting: http://www.nature.com/nature/journal/v525/n7567/full/nature14956.html http://www.nature.com/nature/journal/v525/n7567/full/nature1...
- robert_tweed 10y agoKinda disappointed about the lack of historical data given about the sort of supercomputers used for weather modelling over the years. Mainly because I want to know which era of weather forecasting could conceivably run on my PC, my phone, or the latest Raspberry Pi.
- ghaff 10y agoAs I recall from when I followed the supercomputer space in more detail, weather was one of the areas that tended to use specialized supercomputers like IBM BlueGene rather than big clusters because the weather models were harder to parallelize. Go back in time and I'm sure you'll see quite a few high-end IBM pSeries. Go further back and there will be things like Cray vector machines.
- angry_octet 10y agoNo it is inherently a well parallelizible problem, it is just that code was originally written for the original vector supercomputer CPUs (Cray, NEC SX) and had to be rewritten for MPI style clusters. It ironic because now we have to rewrite everything to use SIMD/vector accelerators (GPUs).
- lucaspiller 10y agoI've always wondered how meteorology works in terms of computer models. As someone knowing nothing, what's some good material to start learning how it works? Now we have powerful computers and lots of data freely available (well maybe less now thanks to Trump), I've always dreamed of running an old computer model say from the 1980s at home.
- aeroman 10y agoYou can do better than the 1980s - the WRF (Weather Research and Forecasting) model [1] is up to date and will run on a PC (albeit not at a super high resolution). You can provide boundary conditions with freely available data from NOAA [2] However, if you want to run the kind of forecasts that a weather center would do, you big issue would be getting input data. Some of the biggest advances in forecasting have come from improving the amount of satellite data being 'assimilated' into weather forecasts - look how much better the southern hemisphere became compared to the northern hemisphere during the early satellite era (1980-2000). Getting this data in a timely fashion is more of a challenge to do at home. [1] - http://www2.mmm.ucar.edu/wrf/users/ http://www2.mmm.ucar.edu/wrf/users/ [2] - https://nomads.ncdc.noaa.gov/ https://nomads.ncdc.noaa.gov/ [3]Page 3 in - http://www.ecmwf.int/sites/default/files/elibrary/2012/14553-background-and-history.pdf http://www.ecmwf.int/sites/default/files/elibrary/2012/14553...
- semi-extrinsic 10y agoAlso, I believe most weather forecasting makes good use of ensemble runs - take your initial data set from observations, introduce N sets of appropriately sized random variations in the initial data, and run N simulations. Then you look e.g. at the the spread of results, giving you information about the certainty of your prediction.
- deleted 10y ago[deleted]
- amelius 10y agoI suppose these perturbations would need to be extremely small, because of the butterfly effect.
- __mp 10y agoA reason for the slow adoption of accelerators is that these code bases are pretty old and mostly Fortran based. I don't think we are going to see a shift to accelerator-based weather models any time soon. The code bases are pretty old and most scientists working on these models don't have the experience or do not want to work in a programming methodology that works well with accelerators (at least that's my experience). Also in a lot of cases people just like to work with an already existing code because they are just doing a PhD and don't want to translate everything to a new language. The COSMO model which I'm working on is 18 years old. We ported the compute intensive part of the model to C++ using a stencil library and integrated OpenACC pragmas (think OpenMP, but for GPUs) in the rest of the code base. I'm not a big fan of OpenACC, because it requires the user to make assumptions on the underlying hardware and quite a bit of thinking to get high-performance code. It is quite time consuming to integrate the pragmas so that the code performs. OpenACC capable compilers used to be very unstable, we regularly got compiler breakages and regressions. It got a bit better since we send the code to the vendors, but we still see regressions from time to time. All (usable) OpenACC implementations are proprietary, so we have a vendor dependency. The PGI OpenACC binaries used to be pretty slow, but it is now almost up to par with the Cray binaries. The successor model to COSMO, ICON, developed at DWD and MPI is also written in Fortran using OpenACC pragmas (and I think OpenMP pragmas because they plan to use it on XeonPhi). The code is interesting in the sense that they are using a icosahedral grid, which stands in contrast to the square grid COSMO uses: Data accesses are not straightforward. Keep in mind that Fortran does not have easy abstractions for data accesses outside of square grids, so you have to use a couple of macros/functions/etc.. to get to the fields you need. Disclaimer: I have not seen the code myself, but the DWD certainly knows how to write high-performance code, so I'm certain most of the code is optimized.
- njharman 10y agoCan we take a moment to reflect on how awesome and revolutionary (in changing world, not its tech) the Linux Kernel (and *nix ecosystem around it). I remember when the TOP500 was being taken over by Beowulf Clusters https://en.wikipedia.org/wiki/Beowulf_cluster https://en.wikipedia.org/wiki/Beowulf_cluster Linux made that happen. At the time (and today) it ran on small embedded systems, to some of the world's fastest supercomputers and practically everything in between. Incredible compared to the alternative contemporary OSs.
- clappski 10y agoFor all it's warts, in my opinion Linux (and *BSD's) are some of the greatest software engineering efforts of our time. I think we'll be lucky to ever see a FOSS kernel reach the same level of ubiquity in our lifetime as Linux.
- olegkikin 10y agoI do windsurfing, and wind prediction is absolutely horrible, especially in the areas with complex terrain. I understand why it's hard, it's a 3-dimensional problem, and pretty much all weather stations are sitting on the surface, and the wind ones are quite sparse. We need 10x-100x more stations/sensors for the data to be good. I've been thinking of ways to create a cheap solution for a simple weather station that would ping the data once a minute to the central server over something like GSM, but I'm more of a software guy. Determining wind strength/direction is not that hard, but making it all weather proof is.
- xapata 10y agoBalloons. The trick is to make them so cheap they're disposable. Preferably bio degradable, though that'd be tough for the electronics. Weather proof is impossible.
- amelius 10y agoOr attach them to large cargo ships?
- froindt 10y agoThat would get us data for areas where almost no humans are nearby. Not too valuable.
- angry_octet 10y agoWrong! We want data from offshore so we can model what happens when the system moves over land. Also, shipping is valuable and has humans who can drown.
- brandmeyer 10y agoThere is a startup that has designed an ultrasonic wind field sensor that can make many measurements of the wind field above the instrument. The instrument is on a smallish trailer, towed by a pickup to the test site. Once there, it can take measurements of the wind field up to 200m or so above the trailer. The idea is to make a cheaper replacement to the met towers that wind turbine site surveys use today. Its much more expensive than a ground-level mechanical anemometer, but also much less expensive than a tower with an anemometer.
- deepnotderp 10y agoApparently perfect simulation will require zettaflops! We can't even achieve exascale right now! (But we'll get there)
- dekhn 10y agoThere is no such thing as perfect simulation. And, it's more likely that when people realize how incredibly hard it is to build exascale machines, and how unproductive they will be, they'll just end up training deep learning models which approximate the perfect simulations well enough and cost-effectively enough on commodity GPUs that nobody will buy or build supercomputers any more.
- deepnotderp 10y agoBaidu estimates it takes ~20 ExaFLOPs to train a deep net. Consider that it's not uncommon to churn through ~100 hyperparamter combinations (let alone architectures), especially for something high end as this, and you realize that deep learning is no escape from the compute problem! There's a reason why the big DL players hire lots of HPC guys for deep learning. And also, parallelizing SGD is a highly non-trivial task, until very recently, you had to linearly lower the learning rate as you added new workers, and keep in mind that bandwidth is far more expensive (both economically, temporally and energy-wise) than compute. That being said, many people are already exploring deep learning for weather simulation (such as Yandex I believe) and it has worked very well, and is near, or beating SOTA iirc, so I definitely think there's a future there. For the record, I think exacsale is achievable, but not with the current architecture (admittedly I'm biased, as a deep learning chip and supercomputing chip startup founder), but I think my objective evidence is pretty strong that with a new architecture, exascale is possible. On the other hand, zettascale may be the end of supercomputer scaling. Moore's law, Dennard Scaling, et al are no saviors either, since communication and scheduling logic now dominates the cost of computation.
- dekhn 10y agoYou mean "20 ExaFLOP". "20 ExaFLOPs" is a per-second measure. FWIW, I work at Google, have a background in parallelizing simulations, and built an execution system that runs huge hyperparameter combinations. We called it "exacycle" because it exceeded 1 exaflop / second (no communication between tasks) using only idle cycles. I think you probably missed my point: it's now pretty well established that for any physical simulation process, you can train a net using far less energy and get an equivalent quality result. The training itself doesn't require lots of communication unless the model is enormous.
- tmsldd 10y agoCould someone please give some references/publications for the algorithms models and implementation strategies that are currently running weather forecast predictions on this machines?
- brandmeyer 10y agohttps://mpas-dev.github.io/ https://mpas-dev.github.io/ This is a model that didn't quite make it as the replacement for the GFS in the US. It had broad backing from the research community, and if you follow their references back you'll find a wealth of research.
- angry_octet 10y agohttp://www.wrf-model.org http://www.wrf-model.org You can run a version of it yourself.
- deleted 10y ago[deleted]