3 ms·
Interestingly, Roblox went down for 73 hours due to a "unique" issue with Consul as well [1]. Great read on how the issue was approached, handled, and ultimate
by gzer0 4y ago
Interestingly, Roblox went down for 73 hours due to a "unique" issue with Consul as well [1].
Great read on how the issue was approached, handled, and ultimately remediated.
[1] https://blog.roblox.com/2022/01/roblox-return-to-service-10-28-10-31-2021/ https://blog.roblox.com/2022/01/roblox-return-to-service-10-...
- jeremyjh 4y agoMost often the issues that take down a site are with core services like network routing, DNS and service discovery. Consul gets mentioned because it’s in that business and isn’t a standard so it gets called out specifically. Zookeeper, HAProxy and various cluster managers also get slagged for this stuff and yeah, sometimes it’s their fault but that’s what it means to be in that business.
- throwdbaaway 4y agohttps://github.com/hashicorp/consul/pull/12080 https://github.com/hashicorp/consul/pull/12080 - this should be the Consul issue that brought down Roblox