3 ms·
Very interesting, thank you. I agree about rethinking how systems are designed - I can see the need to build much more error-tolerant configurations. How did i
by porker 12y ago
Very interesting, thank you. I agree about rethinking how systems are designed - I can see the need to build much more error-tolerant configurations.
How did it work for you farming out the work? Getting up to speed on any codebase (such that you can fix issues under pressure) takes time, and to get people up-to-speed on 3-4 codebases sounds a big investment in them.
- MalcolmDiggs 12y agoYeah, I never ended up letting 3rd parties loose in the code. I saved the actual problem-fixing for myself. I just hired some guys on Odesk to standby with a set of instructions on how to get the servers back up. Their only job is to keep the sites alive, and this is pretty easy because 99% of the crashes I experience can be band-aid'ed with simple restarts and such. So their instructions would say something like: Reboot the server If problem still exists: Do ABC If problem still exists Do XYZ ...stop when site comes back online. ...write up a crash report, send to me with the server logs When I get back on the clock I look over the logs and the report and take my time addressing whatever the underlying issue is.