2 ms·
I'm not sure actually, I have a local NAS/Server rack where I store work related datasets (think a few hundred/thousands 12-15GB .h5 files). And while I definit
by mardifoufs 4y ago
I'm not sure actually, I have a local NAS/Server rack where I store work related datasets (think a few hundred/thousands 12-15GB .h5 files). And while I definitely don't need instant or even super fast access to them, I'm sure it wouldn't hurt either. We already have tons of optimizations and usually process datasets in a cloud environment with "good" IOPS/Network[1] speeds, but it is still faster to use locally in some situations. 10Gbe gear would be a nice to have to avoid bottlenecks within the LAN... but I just realized that I'm making a good case for just shelling out more money instead of cheaping out haha.
[1] As good as it gets on Azure, I guess. Which is not much at all, even on Ultra SSDs so I keep a local cache for smaller scale stuff