4 ms·
What data is used to train this AI? The article doesn't say anything about that (tough I have to admit I didn't read it super carefully). My first thought would
by roelschroeven 2y ago
What data is used to train this AI? The article doesn't say anything about that (tough I have to admit I didn't read it super carefully). My first thought would be exactly all this historical data, but then you can't use that same data to test the AI's performance. Are different subsets of the available historical data used for training vs testing?
- axismundi 2y agoIt's most likely ERA5: https://cds.climate.copernicus.eu/datasets/reanalysis-era5-single-levels https://cds.climate.copernicus.eu/datasets/reanalysis-era5-s...
- scellus 2y agoNo, they say end-to-end, meaning they use raw obsevations. Most or all other medium-range models start with ERA5. There's a paper from Norway that tried end-to-end, but their results were not spectacular. That's the aim of many though, including ECMWF. Note that ECMWF already has their AIFS in production, so AI weather prediction is pretty mainstream nowadays. Google has a local nowcast model that uses raw observations, in production, but that's a different genre of forecasting than the medium-range models of Aardvark.
- counters 2y ago> Google has a local nowcast model that uses raw observations, in production, but that's a different genre of forecasting than the medium-range models of Aardvark. It's very clear from the MetNet announcement blog[1] that they require HRRR or other NWP output at runtime. [1]: https://research.google/blog/metnet-3-a-state-of-the-art-neural-weather-model-available-in-google-products/ https://research.google/blog/metnet-3-a-state-of-the-art-neu...
- wafngar 2y agoThey train with ERA5 and observations.