7 ms·
GPUs open the potential to forecast urban weather for drones and air taxis
- carabiner 5y agoRun this for mountains, ski resorts so we know exactly which areas/runs will be most windy.
- cryptoz 5y agoWell this is the coolest thing I've seen in weather tech in a while. I wonder if they will pair this with additional city-level data collection - anemometers/mini weather stations on the sides of buildings, etc. I'm the barometer-data-from-phones guy running All Clear on Play Store US: https://play.google.com/store/apps/details?id=com.allclearweather.android&hl=en_US&gl=US https://play.google.com/store/apps/details?id=com.allclearwe... with an interest in hyperlocal weather forecasting. I didn't see much about forecast accuracy in this article, but, still, extremely cool. I do wonder how much accuracy is possible - you cannot necessarily know how trucks and other human-caused short-term atmosphere changes will affect the weather.
- billiam 5y agoThis seems a bit much to enable good pizza delivery. The funders seem more interested in urban airflows for bioweapons attacks or other slightly more critical problems.
- quocanh 5y agoThis might enable simulation but forecasting is a chaotic problem isn't it? It's essentially like trying to predict a stream of random numbers - even if they follow a certain attractor, it's still impossible to know exactly what form they'll take.
- zardo 5y agoForecasting is done, and it's done by creating ensembles of weather simulations. Weather is chaotic, which is why forecast accuracy rapidly drops off the further out in time you make predictions. But still, they can be accurate enough far enough out into the future to be extremely useful.
- datameta 5y agoA few years ago I heard it said that a 5 day forecast has the accuracy of a 48 hour forecast from two decades ago.
- heavenlyblue 5y agoIt does seem to me like a lot of that accuracy comes from real-time metric collection from all of the stations around the world (And there are many more stations, too). For example, in London iPhone gives you almost real-time "current weather" state. Stuff like "it's raining now and it's going to stop raining in the next 5 minutes". You can only do that via collecting the radar data in real-time and correlating it with GPS. Not so much prediction.
- dragontamer 5y agoPartial differential equations over multiple dimensions is innately chaotic, with exponential error bounds (the longer any simulation goes, the exponentially bigger the errors get). But getting more-and-more accurate predictions is the goal of any weather modeler. If the exponential error bounds gives you currently 1-day worth of predictions before the models go to crap... maybe an improved algorithm (or 10x more compute power) can get you 2-days worth of predictions instead. Even if you don't get a major change (maybe going from 1 day worth of predictions to 1.1 days of predictions), you might be able to convert that into 1/10th the compute power needed (ex: lower the accuracy down to 1-day prediction but cut back dramatically on the compute-power needed to perform the simulation).
- tppiotrowski 5y ago“CPUs excel at performing multiple tasks, including control, logic, and device-management operations, but their ability to perform fast arithmetic calculations is limited. GPUs are the opposite. Originally designed to render 3D video games, GPUs are capable of fewer tasks than CPUs, but they are specially designed to perform mathematical calculations very rapidly.” I thought the advantage of the GPU is not speed but parallelism or are modern power saving processors also slow compared to GPUs on non-parallel tasks? Also, is it common to use Registered Trademarks (FastEddy) in a paper these days. I know a lot of universities try to commercialize research, is this the reason for the trademark?
- dahart 5y ago> I thought the advantage of the GPU is not speed but parallelism or are modern power saving processors also slow compared to GPUs on non-parallel tasks? Fast and parallel are two ways to say the same thing, or in other words, the wide parallelism of the GPU's many math cores is what makes it faster than CPU's relatively small capability to do math in parallel. (The x-factor is so large, the power saving features don't really make a meaningful difference.) The tradeoff is you need a highly parallel workload to be efficient and that much faster on the GPU.
- foota 5y agoI think they're actually asking, if you have a single "thread" of a GPU, is that one thread quicker at math than a single thread of a CPU? The most fair comparison imo might be a single "warp" in nvidia terms against a single CPU thread, which is roughly similar to what a CPU might be doing for AVX.
- stephen999 5y agoIt’s much slower. GPU single thread performance is very slow. Unless you are doing some specialized operation that has a special instruction on GPU, it will be slower. GPU clock speeds are lower in general and the CPU has a much wider super scalar pipeline. Can be 4-8 wide vs single or double wide for most GPUs. It also has many latency-hiding techniques for a single thread. The GPU has none, it uses multiple threads to hide latency.
- mwambua 5y agoFor some context, WRF (https://github.com/wrf-model/WRF https://github.com/wrf-model/WRF), the current state-of-the-art weather modeling system (also developed by NCAR) can (to my limited knowledge) only run on CPU. There have been efforts to run it on GPU (https://wrfg.net https://wrfg.net)... though it doesn't look like it's been kept up to date. It seems like FastEddy mostly replaces WRF-LES, which is used for high-resolution localized modeling.
- guywhocodes 5y agoThere have been at least 2 cuda implementations of WRF ARW afaik, and it seems they are not widely recommended because of numerical differences from the reference implementation. However having run ARW a lot, I would definitely not do it again on CPU.
- labster 5y agoI’ve been out of the field for a decade now, but I’m not surprised WRF is still the dominant model. So how different is ARW from the reference implementation? Model physics are not quite real physics anyway, and your initial conditions have some garbage and low sig figs anyway. Is the error propagation measurable — does it make long term forecasts significantly worse?
- twofornone 5y agoI'm not a domain expert but I would expect weather patterns to be chaotic and thus even small perturbations (errors) can lead to significant divergence.
- diamondlovesyou 5y agoI'm a level above an amatuer in this, having studied data assimilation in college (I was a Math major). Numerical errors are a given, errors in general too, actually, especially in the measurements used to train the hidden parameters (it is very similar to supervised ML). Data assimilation is a collection of techniques used to tackle that issue: 3dvar, 4dvar, kalman filter, extended kalman filter, ensemble kalman filter, particle filters, and so many others are used to find the most likely (minimum energy etc) hidden state (the mean and covariance) from a given set of measurements+associated covariances and then that resulting hidden state is used to run the model "forward" (generally in time). AIUI, DA was specifically developed for weather modeling. It is definitely true that weather modeling is a heavy employer in anycase. This is on top of the methods used to solve PDEs ie so that they are forward/backward stable etc. The errors in the weather forecast are not the result of chaos: they are the result of the errors in the measurements (recorded in the observation covariance) and the sparsity of the measurements themselves vs the size of Earth, for example, and limitations in model resolution (consider a FEM grid over the entire surface of Earth). The effect of chaos just compounds these errors near bifurcations around fixed points. Perturbations are not used in the way you think; think of Taylor series approximations around specific points of interest. Anyway, I work on compilers/auto-vectorization now (lol), so I'll defer to The Expert, if such person wants to chime in.
- choeger 5y agoBut why? What do I do with a forecast about wind speeds in urban areas? Let's be generous and say the forecast will be able to tell me one hour in advance about wind speed and direction on every street in my neighbourhood. Now I order a drone-delivered pizza. What does the drone do with this knowledge? It still needs to get the Pizza from A to B, ASAP.
- spijdar 5y agoDrones/sUAVs tend to be pretty sensitive to wind and the weather in general. Being able to know, as you put it, the wind speed and direction on every street means being able to potentially avoid significant slow downs and/or running out of battery from having to use more power to compensate for the wind. Of course that's if you can predict the weather with good enough temporal and spatial resolution to be useful. But to me it seems potentially useful.
- RNCTX 5y agoIFR manned flight requires enough fuel to fly to your alternate destination airport + 45 minutes. Considering the idea of flying a drone with something valuable on it is a theft / vandalism / collision nuisance already that will probably never be used outside of a few test markets, I find it highly unlikely that "running out of power" will be a concern. Assuming hypothetically that they were allowed to operate on a larger scale than they are today which, again, is a dubious assumption to begin with, they will have similar reserve requirements that are easy to calculate based on observed wind conditions at a nearby airport.
- jcun4128 5y agoside note: I think it'll be cool/crazy to see some kind of city-level planning that models like cars moving on the ground in real time, and things (drones) flying in the air, 3D buildings/space they take up... that would be a cool system to setup. I thought Airbus was doing something like that for their Vahana since it isn't piloted.
- A-Train 5y agoFor traffic simulation there is https://github.com/a-b-street/abstreet https://github.com/a-b-street/abstreet which is very impressive project.
- jcun4128 5y agoThat looks cool, OSM/(can be) browser based looks like. Wonder if the paths for the roads are drawn automatically. Anyway that's something 3D is just an extruded layer/box I suppose.