3 ms·
Ask HN: Should I try building weather prediction models using machine learning?
Is it realistic for a developer new to machine learning to attempt building weather prediction models with "off the shelf" open source tools? What about hardware? Is it possible to get decent results with modest hardware? (for example, a small cluster of AWS instances).
- harterrt 10y agoDepends on what you're trying to forecast and what you want to use the forecast for. If you're just curious, go for it. If you're planning on trading NG futures, well... go for it, but expect to be disappointed. I'd bet the biggest hurdle you'll face is getting quality data.
- mthoms 10y agoGood point - I should have clarified that I'm only interested in short term predictions at the moment (1-3 days).
- mindcrime 10y agoI'd bet the biggest hurdle you'll face is getting quality data. I guess it depends on what you're looking for, but at least some weather/climate/earth-surface stuff can be grabbed right off the air from the various satellites. Some of that stuff is beamed down unencrypted and anybody with the right receiver setup (which can be as simple as an RTL SDR dongle, AFAIK) can grab the data and use it. http://www.rtl-sdr.com/rtl-sdr-tutorial-receiving-noaa-weather-satellite-images/ http://www.rtl-sdr.com/rtl-sdr-tutorial-receiving-noaa-weath... http://noaasis.noaa.gov/NOAASIS/pubs/Users_Guide-Building_Receive_Stations_March_2009.pdf http://noaasis.noaa.gov/NOAASIS/pubs/Users_Guide-Building_Re... You can also download a lot of data here, although it presumably wouldn't be as timely as getting it direct from the satellite. https://www.ncdc.noaa.gov/data-access/satellite-data/satellite-data-access-datasets https://www.ncdc.noaa.gov/data-access/satellite-data/satelli...
- mindcrime 10y agoI don't know, but it sounds like it would be fun to try. Other than that, all I can add is that I saw this come across my inbox a while back, and it seems like something you might find interesting: https://climate.apache.org/ https://climate.apache.org/
- mthoms 10y agoThanks for that, it looks interesting.
- mthoms 10y agoOP here. I did find this post which was fascinating (but a bit simplistic since it uses only temperature as an input): https://arnesund.com/2015/05/31/using-amazon-machine-learning-to-predict-the-weather/ https://arnesund.com/2015/05/31/using-amazon-machine-learnin...
- gesman 10y agoWeather prediction is an unsolvable task to begin with.
- mthoms 10y agoI don't understand your comment. Since 100% accuracy is unachievable we shouldn't try at all? Wouldn't a prediction with 80% accuracy still be enormously useful in most use cases?