3 ms·
Yes and no. Throughputs are crazy high these days but the rate at which they increase is slower than the rate at which compute increases, by a lot. So if we're
by godelski 4y ago
Yes and no. Throughputs are crazy high these days but the rate at which they increase is slower than the rate at which compute increases, by a lot. So if we're discussing in a relative sense, then there's a growing divergence and thus one can argue that I/O is getting "slower." This is actually one of the major topics in HPC discussion and why there have been so many crazy hacks. Things like flashbuffers are pretty much essential these days. Even if you're doing multi-node ML training you see pretty big differences using infiniband due to the frequency in which nodes need to communicate (there are regularization interval tricks too). In scientific computing this is a big limitation to our ability to visualize at high resolutions and is why in situ visualization is growing popular.
As far as consumer hardware and consumer usages, yeah, everything just feels fast though.