6 ms·

GitLab is down

51 points by cloudking 3y ago

https://status.gitlab.com

marcopicentini 3y ago
Stock is -63% since IPO
- jgalt212 3y ago
  [flagged]
JaggedJax 3y ago
They say just their website is down and that "Git Operations" are working, but I'm unable to use Git over SSH.
- cloudking 3y ago
  Same, I'm intermittently getting this error trying to work with remote repos: git@gitlab.com: Permission denied (publickey). fatal: Could not read from remote repository.
  - dnsmichi 3y ago
    Thanks, confirmed, and updated on https://status.gitlab.com/ https://status.gitlab.com/ to include API and Git Operations. (GitLab team member here)
    - cloudking 3y ago
      Cheers, things seem to be working now
      - dnsmichi 3y ago
        Thanks for confirming. Root cause analysis and more insights have been collected into the incident issue: https://gitlab.com/gitlab-com/gl-infra/production/-/issues/17054 https://gitlab.com/gitlab-com/gl-infra/production/-/issues/1...
- traianturcu 3y ago
  Same here - getting: git@gitlab.com: Permission denied (publickey). fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. It's definitely not just their website.
  - dnsmichi 3y ago
    Thanks for your feedback. Updated in https://news.ycombinator.com/item?id=38071672 https://news.ycombinator.com/item?id=38071672
- dnsmichi 3y ago
  GitLab team member here. Thanks for the feedback, I have forwarded it to our teams investigating the incident.
deleted 3y ago
[deleted]
droptablemain 3y ago
Hopefully an engineer didn't accidentally delete the prod DB again.
- deleted 3y ago
  [deleted]
- highhedgehog 3y ago
  fingers crossed
- Justsignedup 3y ago
  wait wait wait, this actually happened?
  - flakes 3y ago
    See the postmortem https://about.gitlab.com/blog/2017/02/10/postmortem-of-database-outage-of-january-31/ https://about.gitlab.com/blog/2017/02/10/postmortem-of-datab...
    - romanhn 3y ago
      Fantastic post-mortem that I regularly share out with others. A great cautionary tale on the importance of backup testing procedures (aka why "set and forget" with backups is not sufficient).
  - deleted 3y ago
    [deleted]
  - siamese_puff 3y ago
    even better, watch the livestream of it https://www.youtube.com/watch?v=v0TRHLvYGE0 https://www.youtube.com/watch?v=v0TRHLvYGE0
zgk7iqea 3y ago
No wonder people use GitHub even if it scans your repos. If a service is unreliable, why bother?
- ForkMeOnTinder 3y ago
  https://www.githubstatus.com/history https://www.githubstatus.com/history Don't praise GitHub too much. They've averaged an issue every 2 days for the past 3 months.
  - meandmycode 3y ago
    Issues don't mean downtime though, and GitHub has lots more features. For example an issue noted here was stale commits of up to 7 minutes in 9% of new pull requests... I'm willing to bet such issues aren't acknowledged by most platforms
- georgyo 3y ago
  Because GitHub is never down... I'm not sure which one has a better uptime, but GitHub seems to on HN at least once a month https://hn.algolia.com/?dateRange=all&page=0&prefix=false&query=%22GitHub%20down%22&sort=byDate&type=story https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu...
- ryanklee 3y ago
  Without actual numbers, how does this make any sense.
number6 3y ago
Self hosting is the best solution for our team. At least we can blame ourselves if something is down...
- Justsignedup 3y ago
  ... but can you make better uptime? :)
  - number6 3y ago
    Better than GitHub, not better than Gitlab, tbh
- tsak 3y ago
  Funny enough, I used to think that, but overall having the people that actually build the software make a hosted version ends up being better value IMO. Our self hosted Gitlab instance needed a lot of hand holding over the years, occasional memory upgrades and involved much more work than initially anticipated. Also keep in mind that you need to spend time to keep the thing up to date and get latest features, which there have been quite a few good ones added over the years.
  - sieabahlpark 3y ago
    [dead]
  - vaxman 3y ago
    > you need to spend time to keep the thing up to date and get latest features That attitude isn't really conducive to custom software development, but Gitlab has many other purposes.
- ryanklee 3y ago
  How does it follow that because a cloud provider has downtime that self-hosting is a better solution?
  - 3y ago
sherazaslam 3y ago
[flagged]
mdaniel 3y ago
And now it's even worse: https://www.cloudflarestatus.com/incidents/l6x2h1zp69bc https://www.cloudflarestatus.com/incidents/l6x2h1zp69bc https://news.ycombinator.com/item?id=38074906 https://news.ycombinator.com/item?id=38074906

GitLab is down

51 points by cloudking 3y ago

https://status.gitlab.com

marcopicentini 3y ago

Stock is -63% since IPO

jgalt212 3y ago
[flagged]

JaggedJax 3y ago

They say just their website is down and that "Git Operations" are working, but I'm unable to use Git over SSH.

cloudking 3y ago
Same, I'm intermittently getting this error trying to work with remote repos: git@gitlab.com: Permission denied (publickey). fatal: Could not read from remote repository.
- dnsmichi 3y ago
  Thanks, confirmed, and updated on https://status.gitlab.com/ https://status.gitlab.com/ to include API and Git Operations. (GitLab team member here)
  - cloudking 3y ago
    Cheers, things seem to be working now
    - dnsmichi 3y ago
      Thanks for confirming. Root cause analysis and more insights have been collected into the incident issue: https://gitlab.com/gitlab-com/gl-infra/production/-/issues/17054 https://gitlab.com/gitlab-com/gl-infra/production/-/issues/1...
traianturcu 3y ago
Same here - getting: git@gitlab.com: Permission denied (publickey). fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. It's definitely not just their website.
- dnsmichi 3y ago
  Thanks for your feedback. Updated in https://news.ycombinator.com/item?id=38071672 https://news.ycombinator.com/item?id=38071672
dnsmichi 3y ago
GitLab team member here. Thanks for the feedback, I have forwarded it to our teams investigating the incident.

deleted 3y ago

[deleted]

droptablemain 3y ago

Hopefully an engineer didn't accidentally delete the prod DB again.

deleted 3y ago
[deleted]
highhedgehog 3y ago
fingers crossed
Justsignedup 3y ago
wait wait wait, this actually happened?
- flakes 3y ago
  See the postmortem https://about.gitlab.com/blog/2017/02/10/postmortem-of-database-outage-of-january-31/ https://about.gitlab.com/blog/2017/02/10/postmortem-of-datab...
  - romanhn 3y ago
    Fantastic post-mortem that I regularly share out with others. A great cautionary tale on the importance of backup testing procedures (aka why "set and forget" with backups is not sufficient).
- deleted 3y ago
  [deleted]
- siamese_puff 3y ago
  even better, watch the livestream of it https://www.youtube.com/watch?v=v0TRHLvYGE0 https://www.youtube.com/watch?v=v0TRHLvYGE0

zgk7iqea 3y ago

No wonder people use GitHub even if it scans your repos. If a service is unreliable, why bother?

ForkMeOnTinder 3y ago
https://www.githubstatus.com/history https://www.githubstatus.com/history Don't praise GitHub too much. They've averaged an issue every 2 days for the past 3 months.
- meandmycode 3y ago
  Issues don't mean downtime though, and GitHub has lots more features. For example an issue noted here was stale commits of up to 7 minutes in 9% of new pull requests... I'm willing to bet such issues aren't acknowledged by most platforms
georgyo 3y ago
Because GitHub is never down... I'm not sure which one has a better uptime, but GitHub seems to on HN at least once a month https://hn.algolia.com/?dateRange=all&page=0&prefix=false&query=%22GitHub%20down%22&sort=byDate&type=story https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu...
ryanklee 3y ago
Without actual numbers, how does this make any sense.

number6 3y ago

Self hosting is the best solution for our team. At least we can blame ourselves if something is down...

Justsignedup 3y ago
... but can you make better uptime? :)
- number6 3y ago
  Better than GitHub, not better than Gitlab, tbh
tsak 3y ago
Funny enough, I used to think that, but overall having the people that actually build the software make a hosted version ends up being better value IMO. Our self hosted Gitlab instance needed a lot of hand holding over the years, occasional memory upgrades and involved much more work than initially anticipated. Also keep in mind that you need to spend time to keep the thing up to date and get latest features, which there have been quite a few good ones added over the years.
- sieabahlpark 3y ago
  [dead]
- vaxman 3y ago
  > you need to spend time to keep the thing up to date and get latest features That attitude isn't really conducive to custom software development, but Gitlab has many other purposes.
ryanklee 3y ago
How does it follow that because a cloud provider has downtime that self-hosting is a better solution?
- 3y ago

sherazaslam 3y ago

[flagged]

mdaniel 3y ago

And now it's even worse: https://www.cloudflarestatus.com/incidents/l6x2h1zp69bc https://www.cloudflarestatus.com/incidents/l6x2h1zp69bc https://news.ycombinator.com/item?id=38074906 https://news.ycombinator.com/item?id=38074906