5 ms·

Gandi Outage on Multiple Services

8 points by wizbonk 2y ago

deleted 2y ago
[deleted]
wizbonk 2y ago
This has been going on for almost 11 hours according to my logs: Mar 08 17:36:55 ubuntu-vm systemd[1]: Started fetchmail.service - LSB: init-Script for system wide fetchmail daemon. Mar 09 00:41:55 ubuntu-vm fetchmail[1603]: timeout after 300 seconds waiting for server mail.gandi.net. Mar 09 00:41:55 ubuntu-vm fetchmail[1603]: socket error while fetching from [REDACTED]@[REDACTED]@mail.gandi.net Mar 09 00:41:55 ubuntu-vm fetchmail[1603]: Query status=2 (SOCKET) `
- wizbonk 2y ago
  There's a more accurate status on their support pages: https://helpdesk.gandi.net/hc/en-us https://helpdesk.gandi.net/hc/en-us At least they spell out IMAP/POO/Webmail is still down.
  - wizbonk 2y ago
    Looks like IMAP at least is (very slowly) getting back to normal: Mar 10 08:25:25 ubuntu-vm fetchmail[12446]: Authorization failure on [REDACTED]@[REDACTED]@mail.gandi.net Mar 10 08:25:25 ubuntu-vm fetchmail[12446]: For help, see http://www.fetchmail.info/fetchmail-FAQ.html#R15 http://www.fetchmail.info/fetchmail-FAQ.html#R15 Mar 10 08:25:26 ubuntu-vm fetchmail[12446]: Query status=3 (AUTHFAIL) Mar 10 08:30:26 ubuntu-vm fetchmail[12446]: Authorization OK on [REDACTED]@[REDACTED]@mail.gandi.net Mar 10 08:32:32 ubuntu-vm fetchmail[12446]: 1 message for [REDACTED]@[REDACTED] at mail.gandi.net (folder INBOX). Mar 10 08:32:34 ubuntu-vm fetchmail[12446]: reading message [REDACTED]@[REDACTED]@mail.gandi.net:1 of 1 (3401 header octets) (107073 body octets) flushed EDIT: All times are UTC
tomgag 2y ago
Can confirm, POP/SMTP has been down since tonight (EU). Oh well, I take this as a motivation to finally move away from them.
- wizbonk 2y ago
  Me too - but the ability to transfer via the admin portal is down. According to their status page it's: "Service are back to normal to the majority of customers we continue to work so there is no impact for any customers" I beg to differ.
  - tomgag 2y ago
    Yeah, same. EDIT: yes, it looks like it is not possible to disable "transfer lock". Shame on you Gandi, but you know no shame.
fguerraz 2y ago
API is down as well, can make changes to DNS zones, this is insane to have such a long outage.
cpusaremistake 2y ago
After being a customer for about 15 years, finally going to have to move away from Gandi now. The increased costs of mailboxes was already putting pressure on me to move but an outage of this length is the nail in the coffin.
workfromspace 2y ago
I was planning to migrate to Fastmail but I'm curious, how is Fastmail's uptime/service health? It'd be great if their long time customers can share their experience.
- wizbonk 2y ago
  Not fastmail, but I was going to migrate to https://porkbun.com/ https://porkbun.com/. Put it on hold because of issues (which I see is now down to the 72 hour delay) and domain renewals coming up.
  - workfromspace 2y ago
    I heard of porkbun as well, but haven't tried yet. Seems like all in one. So far my registrar is Gandi (don't have enough reason to change it), DNS server is CloudFlare, websites are GH pages and mails will be FastMail so it seems.
JTeim 2y ago
As of 20:37 Paris time, e-mail is still not accessible, neither from my e-mail client nor from the website. Website error message: "Error 503 Backend fetch failed. Varnish cache server". Per the timeline on Gandi's website, we are now at 19 hours without e-mail.
mcflubbins 2y ago
Email (IMAP) is still not functional for me but the status page simply says "Degraded Performance" and is all green...
tomgag 2y ago
22:04 Paris time: still "Service are back to normal to the majority of customers we continue to work so there is no impact for any customers". I guess I am in the "unlucky bunch" then. No POP/IMAP, slow SMTP, no access to DNS panel.
- JTeim 2y ago
  22:17 Paris time : no e-mail. Lyon is now the hinterlands ?
JTeim 2y ago
Domaine name transfer out requires a 72 hour delay. Seriously ?!?
reckondigital 2y ago
Still not working here (1030pm UK time). I'm nearly approaching 24h without email. No IMAP, no webmail. Frustrating to read that "Service are back to normal to the majority of customers" - with no further update for the past 6h!
wassup_b 2y ago
We're now (almost) 24h later, and IMAP is still down for me (Belgium).
- wizbonk 2y ago
  Its been over 30 hours: First failure at 2025-03-09 00:41:55 UTC, and it's now 2025-03-10 07:09:00 UTC. This is unacceptable - this is starting to impact interviews for jobs this week (I've rescheduled one for today just in case).
- JTeim 2y ago
  Same in France (Lyon), but it is 30+ hours without e-mail access (neither via IMAP nor via Gandi's webmail).
DanieleProcida 2y ago
I have had excellent service and support from Gandi for several years. I appreciated having an EU-based provider that seemed to take pride in having a sustainable approach to the business. There was clarity about pricing. It wasn't the cheapest but they were straightforward and honest in communications. Every company has an outage now and then, and sometimes a bad one. But, it has now been 30 hours since I had access to my email. The last update was 15 hours ago. I don't like the way this has been handled.
DanieleProcida 2y ago
I have just been able to log in to my IMAP account. Only one new message in there, from two minutes ago - which suggests that all messages to me have not even reached the inbox yet. Some deliveries will be retried, but after 30+ hours some will have permanently failed.
- JTeim 2y ago
  I can also login via IMAP (but no via the webmail), but emails sent to my account 10 hours ago and 2 hours ago are still not delivered.
- wizbonk 2y ago
  I have fetchmail running, it's slow, but I'm getting all of my emails delivered (I have a forward to protonmail to compare). EDIT: I don't have visibility for emails not forwarded during the initial outage so nothing before 07:30 UTC yesterday.
- wassup_b 2y ago
  My mail has been coming in slowly since 30 minutes ago. I am going to give the mail some time to arrive, and then I will migrate my mail to mailbox.org instead.
deleted 2y ago
[deleted]
workfromspace 2y ago
All my mails seems to be gone. I was just able to access both IMAP and Roundcube (webmail.eu.com), and my archive folder with years of folder does not exist at the moment. I see only 2 emails in the inbox, nothing else. There are no other mailbox folders besides from inbox either. All gone.
- JTeim 2y ago
  As of 11:07 Paris time, my e-mails via Roundcube are still there. However, over the past several hours access to the website was inconsistent (at one point earlier this morning, I could not even login). So, perhaps you will find the emails if you logout, then try again in an hour or two.
- workfromspace 2y ago
  Update: In the afternoon I regained access and mails are restored.

8 points by wizbonk 2y ago

deleted 2y ago

[deleted]

This has been going on for almost 11 hours according to my logs: Mar 08 17:36:55 ubuntu-vm systemd[1]: Started fetchmail.service - LSB: init-Script for system wide fetchmail daemon. Mar 09 00:41:55 ubuntu-vm fetchmail[1603]: timeout after 300 seconds waiting for server mail.gandi.net. Mar 09 00:41:55 ubuntu-vm fetchmail[1603]: socket error while fetching from [REDACTED]@[REDACTED]@mail.gandi.net Mar 09 00:41:55 ubuntu-vm fetchmail[1603]: Query status=2 (SOCKET) `

wizbonk 2y ago
There's a more accurate status on their support pages: https://helpdesk.gandi.net/hc/en-us https://helpdesk.gandi.net/hc/en-us At least they spell out IMAP/POO/Webmail is still down.
- wizbonk 2y ago
  Looks like IMAP at least is (very slowly) getting back to normal: Mar 10 08:25:25 ubuntu-vm fetchmail[12446]: Authorization failure on [REDACTED]@[REDACTED]@mail.gandi.net Mar 10 08:25:25 ubuntu-vm fetchmail[12446]: For help, see http://www.fetchmail.info/fetchmail-FAQ.html#R15 http://www.fetchmail.info/fetchmail-FAQ.html#R15 Mar 10 08:25:26 ubuntu-vm fetchmail[12446]: Query status=3 (AUTHFAIL) Mar 10 08:30:26 ubuntu-vm fetchmail[12446]: Authorization OK on [REDACTED]@[REDACTED]@mail.gandi.net Mar 10 08:32:32 ubuntu-vm fetchmail[12446]: 1 message for [REDACTED]@[REDACTED] at mail.gandi.net (folder INBOX). Mar 10 08:32:34 ubuntu-vm fetchmail[12446]: reading message [REDACTED]@[REDACTED]@mail.gandi.net:1 of 1 (3401 header octets) (107073 body octets) flushed EDIT: All times are UTC

tomgag 2y ago

Can confirm, POP/SMTP has been down since tonight (EU). Oh well, I take this as a motivation to finally move away from them.

wizbonk 2y ago
Me too - but the ability to transfer via the admin portal is down. According to their status page it's: "Service are back to normal to the majority of customers we continue to work so there is no impact for any customers" I beg to differ.
- tomgag 2y ago
  Yeah, same. EDIT: yes, it looks like it is not possible to disable "transfer lock". Shame on you Gandi, but you know no shame.

fguerraz 2y ago

API is down as well, can make changes to DNS zones, this is insane to have such a long outage.

cpusaremistake 2y ago

After being a customer for about 15 years, finally going to have to move away from Gandi now. The increased costs of mailboxes was already putting pressure on me to move but an outage of this length is the nail in the coffin.

workfromspace 2y ago

I was planning to migrate to Fastmail but I'm curious, how is Fastmail's uptime/service health? It'd be great if their long time customers can share their experience.

wizbonk 2y ago
Not fastmail, but I was going to migrate to https://porkbun.com/ https://porkbun.com/. Put it on hold because of issues (which I see is now down to the 72 hour delay) and domain renewals coming up.
- workfromspace 2y ago
  I heard of porkbun as well, but haven't tried yet. Seems like all in one. So far my registrar is Gandi (don't have enough reason to change it), DNS server is CloudFlare, websites are GH pages and mails will be FastMail so it seems.

JTeim 2y ago

As of 20:37 Paris time, e-mail is still not accessible, neither from my e-mail client nor from the website. Website error message: "Error 503 Backend fetch failed. Varnish cache server". Per the timeline on Gandi's website, we are now at 19 hours without e-mail.

mcflubbins 2y ago

Email (IMAP) is still not functional for me but the status page simply says "Degraded Performance" and is all green...

tomgag 2y ago

22:04 Paris time: still "Service are back to normal to the majority of customers we continue to work so there is no impact for any customers". I guess I am in the "unlucky bunch" then. No POP/IMAP, slow SMTP, no access to DNS panel.

JTeim 2y ago
22:17 Paris time : no e-mail. Lyon is now the hinterlands ?

JTeim 2y ago

Domaine name transfer out requires a 72 hour delay. Seriously ?!?

reckondigital 2y ago

Still not working here (1030pm UK time). I'm nearly approaching 24h without email. No IMAP, no webmail. Frustrating to read that "Service are back to normal to the majority of customers" - with no further update for the past 6h!

wassup_b 2y ago

We're now (almost) 24h later, and IMAP is still down for me (Belgium).

wizbonk 2y ago
Its been over 30 hours: First failure at 2025-03-09 00:41:55 UTC, and it's now 2025-03-10 07:09:00 UTC. This is unacceptable - this is starting to impact interviews for jobs this week (I've rescheduled one for today just in case).
JTeim 2y ago
Same in France (Lyon), but it is 30+ hours without e-mail access (neither via IMAP nor via Gandi's webmail).

DanieleProcida 2y ago

I have had excellent service and support from Gandi for several years. I appreciated having an EU-based provider that seemed to take pride in having a sustainable approach to the business. There was clarity about pricing. It wasn't the cheapest but they were straightforward and honest in communications. Every company has an outage now and then, and sometimes a bad one. But, it has now been 30 hours since I had access to my email. The last update was 15 hours ago. I don't like the way this has been handled.

DanieleProcida 2y ago

I have just been able to log in to my IMAP account. Only one new message in there, from two minutes ago - which suggests that all messages to me have not even reached the inbox yet. Some deliveries will be retried, but after 30+ hours some will have permanently failed.

JTeim 2y ago
I can also login via IMAP (but no via the webmail), but emails sent to my account 10 hours ago and 2 hours ago are still not delivered.
wizbonk 2y ago
I have fetchmail running, it's slow, but I'm getting all of my emails delivered (I have a forward to protonmail to compare). EDIT: I don't have visibility for emails not forwarded during the initial outage so nothing before 07:30 UTC yesterday.
wassup_b 2y ago
My mail has been coming in slowly since 30 minutes ago. I am going to give the mail some time to arrive, and then I will migrate my mail to mailbox.org instead.

deleted 2y ago

[deleted]

workfromspace 2y ago

All my mails seems to be gone. I was just able to access both IMAP and Roundcube (webmail.eu.com), and my archive folder with years of folder does not exist at the moment. I see only 2 emails in the inbox, nothing else. There are no other mailbox folders besides from inbox either. All gone.

JTeim 2y ago
As of 11:07 Paris time, my e-mails via Roundcube are still there. However, over the past several hours access to the website was inconsistent (at one point earlier this morning, I could not even login). So, perhaps you will find the emails if you logout, then try again in an hour or two.
workfromspace 2y ago
Update: In the afternoon I regained access and mails are restored.