3 ms·
> There is no magic threshold where science simulations suddenly work better as you scale up. For certain problems there are absolutely magic thresholds. ML wa
by bbatha 2y ago
> There is no magic threshold where science simulations suddenly work better as you scale up.
For certain problems there are absolutely magic thresholds. ML was famously abandoned for 2 decades because the computers were too slow, and the ML revolution has only been possible because of having a ~teraflop on a per-machine level. Weather and climate models are another where there have been concrete compute targets, a whole earth model requires about 10 teraflops (hence the earth simulator super computer). ~1 meter resolution is an exascale level target.