3 ms·
> calculation that can't be subdivided into parts -- e.g. weather I'm not sure how weather simulation work but I always wondered why they aren't performed cell
by jobigoud 7y ago
> calculation that can't be subdivided into parts -- e.g. weather
I'm not sure how weather simulation work but I always wondered why they aren't performed cellular automaton style. Bottom up rather than top-down. At each time step a given cell state is computed based on the state of its neighbors at t-1. This should be parallelizable. I feel it's also how it works in the real world anyway.
- petschge 7y agoThat is exactly what weather simulations do. Same most other kinds of hydrodynamic simulations (simulation of gas or fluid flows). The thing is: you need the state at t-1 of all your neighbors. Then you can do a small timestep to get from t-1 to time t. And then you need the NEW state of your neighbors. That requires a fast interconnect. Which HPC machines have, unlike most clouds or commodity clusters. In other words, yes it is parallelizable, but not trivially so, because the different grid points are coupled.
- kvakkefly 7y agoI’ve seen that azure has some nodes with infiniband connection (same that is often used in super computers). I did my PhD in physics simulations (molecular dynamics), and have the same problem there. I tried running these simulations in Google Cloud without any good performance results due to high latency (compared to HPC). I’m no GC expert though, so should be possible to improve what I did.
- glaberficken 7y agoFor a simplified explanation of how weather prediction models work check out: NOVA: Decoding the Weather Machine Available on Netflix for example: https://www.netflix.com/title/81121177 https://www.netflix.com/title/81121177