4 ms·
Before all the trolling about Microsoft starts up, does anyone have current information on what these systems are? In the enterprise space, a 'data storage sys
by igni 8y ago
Before all the trolling about Microsoft starts up, does anyone have current information on what these systems are?
In the enterprise space, a 'data storage system' could be an Array or a SAN or a lightpath etc, with usually quite long failover times. For an org like GitHub I'd think more like an object store (an Array-of-Hosts, if you will) or whatever storage mechanism holds their database files. Do they self host this sort of thing or is it an AWS/GCE/Azure service?
FWIW, all git commands are working fine for me (create a branch, push, colleagues can fetch my branch), but the UI doesn't show my branch & nor can I review/comment on PRs.
- reindeerer 8y agoI think it's obvious that it's their SQL storage that holds the website up that is pretty much in read-only mode, and has been for a couple hours now, not the git repos themselves.
- geerlingguy 8y agoYeah, been trying to post comments and new issues and keep getting "405 Not Allowed" responses.
- sciurus 8y agoFor storing things other than git repos, GitHub is heavily invested in MySQL. AFAIK all of GitHub is hosted on their own hardware. https://githubengineering.com/mysql-high-availability-at-github/ https://githubengineering.com/mysql-high-availability-at-git...
- rurban 8y agoThis blog post describes exactly the scenario we were experiencing here. A master (single writer) failure, with missing fail over. You can only guess what went wrong with this plan. Looks good on paper, but some unexpected network or HW or routing problem could have caused the problem to identify the single writer.
- friedman23 8y agoI can push a branch but I cannot access the pull requests that I create off of that branch
- dvfjsdhgfv 8y ago> Before all the trolling about Microsoft starts up, does anyone have current information on what these systems are? To be fair, you can't call it trolling without knowing for sure that the problem hasn't been caused by Azure-related part of the infrastructure. Looking forward to reading the post-mortem.
- jononor 8y agoIt is incredibly unlikely that there is any Azure in the production infrastructure. The acquisition is too recent for big changes like that.
- paavohtl 8y agoIt's actually so recent GitHub hasn't even been acquired yet. That's going to happen some time next year.
- deleted 8y ago[deleted]
- dvfjsdhgfv 8y agoI admire your confidence but will withhold my judgement until the postmortem is published.