5 ms·
Deep learning for twelve hour precipitation forecasts
- meghan_rain 4y agoI would love to read a science fiction story about an AI scientist that is monitoring the output of an AI weather model as a hobby, and then suddenly, on a seemingly completely normal day, sunny, windless, the AI starts screaming bloody murder, huge red warnings everywhere, like the world is about to end. spooky just to think about it. could be a fun thriller
- gazpachotron 4y ago“Huh. Management isn’t going to like this,” said the data scientist. “Tell you what, let’s just agree it’s an outlier, and delete it. I’ve got tickets to close and the sprint ends tomorrow, I don’t have time for this.”
- jerpint 4y agoHBO hit series material
- jacquesm 4y agoIt's could be pretty short if the AI was right all along... a series of 1 episode.
- deafpolygon 4y ago"The AI warned us! Only the AI can save us now!" New series of propaganda shows to get people to empathize with AI.
- deleted 4y ago[deleted]
- lamchob 4y agoThis reminds me of a movie, the name of which I can’t remember. > A family father gets premonitions about a massive storm that will come, which triggers him building a bunker in his back yard. It is a family drama on how his obsession with protecting his family slowly tears it apart. In the end they convince the father to go on vacation for a few days, just to get away from the obsession. As they arrive in their vacation home, a huge, black storm cloud rolls in on the horizon Great Movie, recommend watching it.
- simon_000666 4y agoTake shelter, 2011. +1 for great movie
- whatshisface 4y agoThe last place you would want to be in a rainstorm is underground, right?
- janwillemb 4y ago"build a boat," the AI said.
- hyperthesis 4y agoKinda what happened in the first ever use of cfd to predict weather (which predated digital computers - all calculations were done by hand). Spoiler: there were no calculation errors, but the method was unstable (a kind of positive feedback where errors "blow up"). Does this count as "AI"? Kinda - maybe even god-like. Anyway, everyone just ignored it. Except the scientist, who I suspect FTF out.
- boredemployee 4y agodid anyone run their code successfully?
- ttul 4y agoI’m an armchair, skill-free weather enthusiast. The HRRR model is amazing because it runs every hour, predicting the next 18 hours with considerable reliability. To do better than the HRRR, with significantly less computational effort must be causing a lot of meteorologists a degree of discomfort.
- trash3 4y ago[dead]
- ellisv 4y agoIf you like HRRR, checkout MRMS.
- counters 4y ago> To do better than the HRRR, with significantly less computational effort must be causing a lot of meteorologists a degree of discomfort. It doesn't cause any such discomfort, because in the grand scheme of things, while this is still very impressive and interesting work, it's still a toy in comparison with what tool like the HRRR is typically used for. Reported increases in performance are skewed towards the first few hours of the forecast, where all CAMs generally have some issues because of inconsistencies between the assimilated model initial state and the real-world (e.g. small deficits in the structure of convective systems at the initial state can dominate precipitation forecast skill at short lead times), and where traditional nowcasting systems are already significantly superior. There's little evidence reported that this modeling paradigm can even fundamentally tackle the most critical aspects of short-term mesoscale/convective forecasting, which is hysteresis - the initiation of convection and the structure it takes on in different environments. This is _by far_ the most important way that the HRRR is used to aid in short-range forecasting. In the long arc of things, the community is very, very excited to see how novel approaches involving things like generative AI could lead to next-generation warn-on-forecast systems and large ensembles. And while this paper is a cool early step in this direction, it's a very small one in the bigger picture.
- deleted 4y ago[deleted]
- whatshisface 4y agoIt makes sense that there would be better strategies for simulation than gridding Navier-Stokes (the regularities in weather phenomena show that the space of likely possibilities isn't evenly distributed throughout the space that values on an evenly spaced lattice represent) but it's probably too complicated to come up with those schemes manually. If I had to guess what the model is "doing," (as opposed, say, to compensating for undiscovered problems with data acquisition) that would be it.
- ALittleLight 4y ago"These properties can not only offer improved forecasts, but also frequent and personalized forecasts" I'm imagining those weather stations you can buy for your house coming with a GPU and a local model you can finetune on your own measurements and the measurements of people nearby - get an ensemble of predictions from neighboring models... Seems like a neat addition to a smart home.
- counters 4y agoYou don't need any of that, all you need to do is collect personal weather station data and use it to statistically post-process/correct numerical model output that is already freely available. This has already been done several times over in the weather industry; it doesn't lead to much of an improvement in forecast quality. Trying to run your own model with nearby inputs is kind of pointless because to actually assimilate measurements in your neighborhood, you'd have to run at an absurdly high resolution that makes it way too expensive to run an operational forecast as a commodity. You'd be limited in the size of the forecast domain, so within a few hours (maybe a day at most), your forecast would be dominated by boundary conditions from the parent regional/global models you force it with, and there would be no further propagation of information from your local observations to refine the forecast.
- YeGoblynQueenne 4y agoI haven't got a clue about meteorology, but I know a thing or two about machine learning and the majority of papers in the field remain interesting prototypes because they are tested in the same way: namely, on a test dataset that is already known and readily accessible during training -by the experimenters, and thereofore, indirectly, by the training model itself. This is the case with this paper, from which I quote (see section "Dataset creation and splits"): >> The available data spans a period from July 2017 to August 2020. In other words, they have shown that their system works better than an earlier system on old data. It can predict rainfall in a three-ish year interval in the past. Show that your approach works on real-world data, that you didn't have access to when training your model. Show that your models can predict the future, not the past. Otherwise, your experiments don't mean, what you think they mean. Edit: and to make it perfectly clear for the uninitiated: when you, as an experimenter, know the "ground truth" of your test data, there is nothing easier than to tune the training of your model to maximise its performance on the test data. That's doubly so, and doubly as dangerous, with neural nets that are very, very good at reproducing their training set, but very, very bad at generalising beyond it. Unfortunately, this is what the vast majority of experiments in machine learning do: they test on known data. The result is that nobody really knows how good the tested systems are until they deploy them in a real environment (if they ever do, which they usually don't, because the whole point was writing a paper to report improved performance, and then move on to the next).
- thrwawy74 4y agoAs an anecdote, I just started a masters in data analytics and I've been having a lot of fun asking ChatGPT for help detecting overfitting and useful terms like the mean squared error (MSE).
- kleiba 4y agoI find it surprising to learn that deep-learning approaches are _not_ yet the state of the art.
- IshKebab 4y agoI don't. Weather prediction is a physical process with (I assume) fairly well known laws. That's the wheelhouse of traditional algorithms, not deep learning.
- PaulDavisThe1st 4y agoBut the "known laws" are too convolved with chaotic behavior, which is why making predictions from them is really hard. There's an analogy to the 90s dream of replacing fluid dynamics with its differential equations with cellular automata. The claim made about the former is that the "variables in the equations represent real things in the world", but in the end it is all just a story. If the cellular automata/neural modelling can tell a better story ....
- counters 4y ago> But the "known laws" are too convolved with chaotic behavior, which is why making predictions from them is really hard. This canard always gets thrown out but the application here is flawed in two very big ways. First, "chaotic behavior" does not mean "unpredictable behavior." Modern numerical weather forecasting already deals with this through ensemble modeling techniques and other approaches designed to capture the statistics of the evolution of the weather, not just a single deterministic state. Anyone selling you a deterministic weather forecast from a single model is robbing you. Second, DL will suffer the same challenges here because many AI-based weather forecasting tools are auto-regressive, where a model output is used to seed the next step of the forecast. So the AI approach doesn't actually escape this hypothetical limitation (in fact it might compound it badly).
- PaulDavisThe1st 4y agoGood points, of which I was aware (mostly). I was trying to dispel the "just because you know the laws of physics you can make predictions based on them (alone)" tone of the GP. But thanks for doing a better job at that than I did.