3 ms·
But would GPFS really be any better? What other competition is there for big iron hpc distributed storage?
by SEJeff 9y ago
But would GPFS really be any better? What other competition is there for big iron hpc distributed storage?
- pinewurst 9y agoLustre nominally scales higher than GPFS, but GPFS is more reliable and better performing for anything having to do with metadata. It's also a lot more expensive license-wise. There's other competition, but it's not proven at these scale levels. Top 500 deals are bad business so it's not really worth it to develop/test for them thus leaving the business to the incumbents (e.g. the dumpster fire that's IBM or the Arkham Asylum that's Lustre).
- SEJeff 9y agoFYI I work directly with the amazing guy who wrote this: https://csc.fi/web/blog/post/-/blogs/the-largest-unplanned-outage-in-years-and-how-we-survived-it https://csc.fi/web/blog/post/-/blogs/the-largest-unplanned-o... Lustre at scale is a disaster, but one you can pay for people to help you with. GPFS is unbelievably expensive, but is a lot more reliable wrt metadata, but it is also quite fragile. In my original question, I mean other than the obvious one of Lustre.
- labster 9y agoI'm sure the GFS model will be better with a faster computer. We can get more ensemble runs, at the very least.
- SEJeff 9y agoI was referring to GPFS as in IBM's commercial General Parallel FileSystem, not the Global Forecast System.