4 ms·
It's because of the constant churn in Google's shared infrastructure. I've been the maintainer for production services left orphaned by departing ex-Googlers.
by nostrademons 2y ago
It's because of the constant churn in Google's shared infrastructure.
I've been the maintainer for production services left orphaned by departing ex-Googlers. They usually go down within 3-6 months of their previous maintainer departing - either there's some PCR because the cluster they're homed in is going down for maintenance or transferring to another datacenter, or their dependencies migrate to a new RPC format, or somebody sticks a new quota on internal requests for a service, or your PA loses machine budgets, or your RPC deadlines are now more than the average latency for that service. It's stupid stuff like that - assumptions that worked a few years ago don't work anymore when the infrastructure is a moving target.
Google's code is immensely complex, so once the institutional knowledge goes out the door, debugging and fixing problems becomes very difficult. Your maintainer, once the original author has left, is probably doing this as an unfunded 20% project; she will get zero credit on her performance review for making sure that a service her VP doesn't care about stays up. So it's usually easier to do nothing and just let it start failing. Announcing a turndown is actually a courtesy in this case.
- nitwit005 2y agoI am at a different large company. We got a pile of alerts for a service's staging environment being unused. Of course it's unused, we haven't done a release in months. We clicked the appeal process on those alerts. You could tell from their response that this was a novel concept.
- worksonmine 2y ago> Google's code is immensely complex, so once the institutional knowledge goes out the door, debugging and fixing problems becomes very difficult. How complex can a static (since there's no new URLs being added) URL shortener get? If it's really that bad just rewrite it to something simpler in an afternoon and be done with it. It must be a better option than the bad will of sunsetting something like this will generate no?
- nostrademons 2y agoHa ha ha. Have you seen the Broccoli Man short? And that was a satire of what Google's infrastructure looked like in 2010. https://www.youtube.com/watch?v=3t6L-FlfeaI https://www.youtube.com/watch?v=3t6L-FlfeaI