4 ms·
So the entire business was happy to go offline for 2/3 weeks whenever their infra person fancied going off on their summer holiday? By doing this, you're guara
by roryirvine 8mo ago
So the entire business was happy to go offline for 2/3 weeks whenever their infra person fancied going off on their summer holiday?
By doing this, you're guaranteeing a bus factor of below 1. I can't think of any business that wouldn't see that as being a completely unacceptable risk.
- jononor 8mo agoBus factor 1 is rarely enough for "entire business". But if the GPUs are for training models, and their users are the data scientists that are also on holiday around the same times - that might indeed be good enough policy.
- Aurornis 8mo ago> and their users are the data scientists that are also on holiday around the same times I’ve seen this before. It turns into restrictions on when you can schedule vacation times. Not fun when your family wants to go on a trip but you can’t get the time off because it’s not one of the allowed vacation times.
- jononor 8mo agoOuch, that is indeed a risk one must be wary of. Can be a "works for the company but sucks for employees". Which can also drain the company of skilled people, a poor trade in most cases.
- Aurornis 8mo agoI agree. I never understand the drive to stay away from cloud services for small scale operations. It’s not your money that’s being spent on the cloud, but it is your free time being asked to be on call when you encourage your company to self-host!