4 ms·
Superfast Microsoft AI is first to predict air pollution for the whole world
- mewpmewp2 2y agoIt would be great to highlight some quick samples of predictions and results?
- WarOnPrivacy 2y agoAn AI model developed by Microsoft can accurately forecast weather and air pollution for the whole world in less than a minute. predict the levels of carbon monoxide, nitrogen oxide, nitrogen dioxide, sulfur dioxide, ozone and particulate matter. Its predictions span five days...at [much less] cost than...ECMWF [model], which predicts global air-pollution levels Aurora’s predictions were of a similar quality to those of the conventional model. After 1st read-thru, I believed the article was touting promise as result. As I wrote the above synopsis, I zeroed in on the part about the performance comparison to the conventional model. Not sure why I couldn't pick it out at first.
- hiddencost 2y agoThe important part is the speed. The current models require supercomputers and many hours. This model requires one chunky GPU machine and minutes.
- greybox 2y agoIt's probably bullshit though isn't it.
- goldbrrg 2y agoI also have an AI model that can predict air pollution for the whole world. Current prediction: YES
- nmitchko 2y agoTin-foil hat time: 1. First, models will predict pollution. The outcomes will help shape urban policy. But these won't solve crime or stop people from driving. 2. Second, models will predict individual behavior and track person level emissions. The outcomes will force behavior changes, mostly freedom limiting. 3. Third, and finally, models will predict thoughts. The the thought of driving instead of walking might trigger a response. It's a slippery slope and we need to draw a line between prediction and policy.
- userbinator 2y agoIndeed this is the another thing pushing us towards dystopia. Now it's "climate change" . Previously it was drugs and terrorism.
- deleted 2y ago[deleted]
- mpalmer 2y agoThat is some heavy-duty foil in your hat there. Even allowing for the ridiculously massive technical leap from 1 to 2 and then 2 to 3, it doesn't make much sense. For one thing, if states are determined to enforce individual emissions limits, they can do it today with legislation. You don't need a predictive model. What does the model add? Also, the only difference between 2 and 3 is whether a person acts on a thought. So are you suggesting with #3 that predicted thoughts (e.g. not literal mind reading) which a person doesn't act upon will prompt state action?
- MSFT_Edging 2y agoWhy is it that freedom is always tied to the right to pollute as much as possible, as opposed to the right to live in a world with low pollution?
- mpalmer 2y agoUsing the unqualified word "freedom" has an ambiguity that political actors exploit. Freedom to do something is entirely separate to "free to live in a world where ___". To be honest, I feel the latter sense of the word is a bit of a stretch - semantically, not politically. But you see it because "freedom" is a powerful word in politics, and rather than argue against "freedom", pundits go up the ladder of abstraction and argue the definition instead.
- samfriedman 2y agoLots of work in this space now. See this article from yesterday: https://arstechnica.com/ai/2024/06/as-a-potentially-historic-hurricane-season-looms-can-ai-forecast-models-help/ https://arstechnica.com/ai/2024/06/as-a-potentially-historic...
- zulban 2y agoThere's a lot of excitement in this space but a lot of weather centers are really struggling to get even a tiny fraction of the resources and talent needed to start using these results in real operational systems. Everyone is still using fortran physics code from the 90s.
- aeroman 2y agoOne thing I found really interesting abou the Graphcast paper (I appreciate this is not graphcast, but I think it is still relevant) is that it doesn't understand climate change. The model requires the training data to be recent to get the best quality projections. While there are some factors that influence predictability in the weather forecast, as the fortran code is based on physics (at least in a broad sense), it doesn't suffer from those issues in the same way. This doesn't mean that the ML forecasts are wrong (obviously), just different. Given the relative computational simplicity of running them, I wonder if the issue is not just expertise, but also understanding how they can best be used to generate reliable weather forecasts?
- kristopolous 2y agoBut IBM owns weather.com. Oh wait, that's right. IBM owns weather.com.
- jeffbee 2y agoThere's nothing wrong with fortran and doing computational fluid dynamics in fortran is a mature field of endeavor.
- convolvatron 2y agothis is true. and the extreme amount of experience and tuning required to run these models is really not appreciated outside scientific computing but you have to admit, they are really gross to work with
- ecmascript 2y agoI wonder how these articles get written, do they get to see the results or do they simply trust whatever they say at Microsoft? In my experience stuff like this is often vastly overestimated but if it really can do what it says it's great but I would like to see some examples.
- hiddencost 2y agoThe article is about a paper that is published in Nature. Nature will frequently do this (publish a paper and then also have their editorial staff write a more accessible piece about the paper.)
- counters 2y agoActually, the paper isn't in press at Nature - it's only published on arXiv. It seems a little bit unusual that Nature would publish this sort of news article for a work that hasn't been peer-reviewed.
- pintxo 2y agoIf this thing is trained upon the existing models input + output, doesn't this just mean that the AI is a duplicate/aggregate of the existing model/models? E.g. the quality should be the same if trained on a single model, might be better when trained on multiple? > The researchers trained Aurora on more than a million hours of data from six weather and climate models. After training the model, the team tweaked it to predict pollution and weather globally. The model generates a ten-day global weather forecast alongside the air-pollution prediction. Edit: Added the quote from the article where they confirm the model is trained on existing legacy models.
- giantg2 2y agoIs it possible it formed new inferences based on the analysis of the pervious models and their accuracy or errors? That would be the interesting part, but I'm not sure that was the case.
- pintxo 2y agoThe interesting conclusion from this seems to be that the AI then could only get better when the underlying models improve, right? So we'd still need to keep working on them anyway, or not?
- vessenes 2y agoThe idea generally for these models is: get an architecture that can copy outputs of a very slow process, ablate to see what you can discard from the architecture so that it will run more efficiently, train the heck out of it, then deliver something that’s 10-10000x more efficient than original process. This is the same broad plan used for Alphafold — and for things like Stable Diffusion turbo. It’s rare that these efforts yield interesting new output; they’re usually made specifically for the space/time speedup. In this case, weather predictions that are crazy fast/cheaper to run are seen as a public good, and so sending around a ‘compressed’ version of the big simulations is great.
- jhrmnn 2y agoIndeed, it's along these lines: https://www.microsoft.com/en-us/research/blog/ai4science-to-empower-the-fifth-paradigm-of-scientific-discovery/ https://www.microsoft.com/en-us/research/blog/ai4science-to-...
- archgoon 2y agoIf you should peruse the paper that they published, be aware that the actual meat of the paper is in the supplementary section, past the citations. I was extremely disappointed the paper until I realized that.
- beeboobaa3 2y agoCan it also do something about the problem?
- counters 2y agoThe evaluation of the air pollution / chemistry forecasts in the arxiv paper [1] is really threadbare and entirely disconnected from the actual literature of atmospheric chemical transport modeling and air quality forecasting. The highlighted success case - a sandstorm, where PM10 is the key parameter being analyzed - is probably entirely explained by adequate performance of the underlying "weather" portion of the model (e.g. there is obviously a very strong correlation between intense winds and sandstorms in a desert), but the authors don't provide a more nuanced discussion of the forecast meteorology and transport dynamics of that scenario. It's cool that their model has learned about this relationship, but a greater editorial point is that _we already have global air pollution models_ - particularly, the one this model was trained (fine-tuned) against! That's not to discount all the really novel and interesting new developments with this paper, but the editorialization around AI applications in the weather and climate space is getting way out of hand, especially when most of these applications are incremental improvements at best over the existing technology in the field (with the key exception of cost/efficiency of generating forecasts - that's a true revolution). The Aurora paper is really cool, but issues like these greatly temper my enthusiasm for it. I hope that the research team seeks input and collaboration with domain experts in meteorology and atmospheric chemistry in the future to find ways to leverage this new technology in impactful and useful ways that actually will benefit society. [1]: https://arxiv.org/html/2405.13063v2 https://arxiv.org/html/2405.13063v2
- gopher_space 2y ago> I hope that the research team seeks input and collaboration with domain experts From my perspective ML in general has a weird relationship with cross-domain collaboration. The discussions around linguistics feel like they're full of similar examples and it comes off as a lack of curiosity.
- CyberDildonics 2y agoIf they want to predict something impressive and quantifiable, they should predict the weather further out and more accurately.
- Proven 2y ago[dead]
- ldehaan 2y ago[dead]