63 ms·
We operate with a cattle and pet model [0], and we use a lot of services on that cattle servers. Their power can go out, disks can go bad, hardware can fry. We'
by bayindirh 5y ago
We operate with a cattle and pet model [0], and we use a lot of services on that cattle servers. Their power can go out, disks can go bad, hardware can fry. We've seen a lot of things. As an HPC center, we absolutely hammer what we have.
Even manufacturers baffled how we can fry our servers. We're eating memory controllers in one generation, and on board NICs were being cooked on others for example.
XFS and EXT4 can handle a lot of abuse, incl. power loss without any problems during a heavy write. Regardless of the services we run, we didn't loss any data during a power outage, and for us, power outage means "power outage during full load".
Making sure that your scientific computation can continue from the point you left it is a big business. Nobody wants to lose three weeks or a month just because a server gave out its magic smoke.
[0]: https://www.engineyard.com/blog/pets-vs-cattle/ https://www.engineyard.com/blog/pets-vs-cattle/