11 ms·

Moving Google Contacts and Calendar to NextCloud

219 points by neoglow 5y ago

mastazi 5y ago
I did this move about a year ago, in addition I also moved my email from Gmail to a self hosted instance of Mail-in-a-Box. I never had any issues with either NextCloud or Mail-in-a-Box, I'm pretty happy about those.
- neoglow 5y ago
  Interesting; I am quite hesitant to move from Protonmail to a selfhosted mail. How long have you been selfhosting your mail? How do you deal with spam? Are your mails always received at the other end? Love to hear about this!
  - _a9 5y ago
    I moved to selfhosting email about 2 years ago from google gsuite. I use mailcow[1] and have it on Hetzner Cloud. I don't send much but they have always gotten to their destination. Spam is very minimal, next to zero. Mailcow has built in spam detection with rspamd and lets you train it if any spam does get through just by moving the email to your junk folder. Another big thing I love about mailcow is that it has sync jobs so I can create mailbox's within it and have it sync my emails from other gmail accounts I have or really any mail host that you can connect to with IMAP. You can even set it so it deletes the email on the source account, which is great as most of my extra gmail accounts are just used to receive. The dashboard is pretty great too and you only really need to use the shell, apart from the initial install, to update it every now and then. So many great things I have to say about it and how you can super power it like hosting custom domains and nextcloud among other things. I'm glad I made the change to selfhost. If you know what you're doing I'd 100% recommend you test out running your own mail server for a bit to test the waters. 1: https://mailcow.email/ https://mailcow.email/
    - neoglow 5y ago
      Thank you for taking the time to share your experiences. Will definitely check this out!
    - mongol 5y ago
      What does your mail solution cost you, per month?
      - _a9 5y ago
        Late reply but it's around 15 euro. I'm using the CPX31 on Hetzner Cloud[1]. It holds my main setup and the extras like nextcloud, custom domains, etc. https://www.hetzner.com/cloud https://www.hetzner.com/cloud
  - deleted 5y ago
    [deleted]
  - dqv 5y ago
    Not the person you’re replying to, but I’ve been running MIAB (mailinabox) for business and personal since 2016. I haven’t seen any major issues with deliverability but YMMV. You have to register with all the feedback loops. Once you do, you get feedback when something you send gets marked as spam. Spam on MIAB is handled with postgrey and with spamassasin. It’s pretty good, although I’ve had recent issues with spam coming from gmail and hotmail. I’ve also customized some of the config to bounce Microsoft Sharepoint and Google Docs since neither companies control spam coming from their networks.
  - ajosh 5y ago
    I'm self hosting with mail-in-a-box as well. It comes with a nextcloud install. It hasn't been flawless but it's been good and I'm happy to have some control. With e-mail, I haven't had any problems with one exception. When e-mailing the local school system, they reject my e-mails. I looked into it and it turns out that their spam provider was blocking me because I was a private domain or something like that. It was a configuration on their side. Their tech support told me that I should "get an e-mail address with a normal extension." Outside of that issue, my e-mails have gotten delivered. Between graylisting and the built-in spam filter software, I haven't had any spam issues. It's been smooth as far as that goes. The webmail (roundcube) isn't as nice as gmail but desktop and mobile clients are good in any event. The mail-in-a-box nextcloud install does use sqlite which means that you should make sure to backup contacts in case sqlite breaks. It broke for me once but I was able to copy my contacts from Thunderbird back into the system without any real problems. Calendaring works pretty well with Nextcloud but I haven't found any calendar software that I really love. The web software is good but not super fast. Lightning has gotten better but still feels bolted on. Kontact calendar is too groupware-oriented for my personal use. Evolution never quite felt right to me. The built-in Apple calendar and Samsung (Andriod) calendar apps work fairly well.
  - mastazi 5y ago
    I self-host on a small-ish VPS. I don't really have to deal with spam, mail-in-a-box comes with pre-configured spamassassin. I haven't had issues with deliverability. When I created the box I did a scan of the IP and domain, found out that one antispam provider was blocking my IP, I sent a request to unblock it explaining this is my new IP I just acquired, they unblocked it. That was the last time I had to deal with deliverability issues, in any case I have an automated warning that I set up on MxToolBox. Let me know if you have more questions.
  - justsomehnguy 5y ago
    > Love to hear about this Not quite the same question you've asked, but I found (since 2014) what you can host anything if you front it with FastMail. Ping me if you interested, currently on mobile (and in the bar).
estaseuropano 5y ago
What i miss un articles like this is the server/hardware choice and reasoning for it. The instructions how to setup nextcloud are on the nextcloud homepage, so no reason to repeat them.
- neoglow 5y ago
  Author of the blogpost. Thank you for your feedback. The problem with hardware choice, is that many selfhosters have really low-power, budget, powersaving hardware, including myself. The point of this article was for me to discover how I could move some of my data away from Google, of which this is one piece. I had this running on a Raspberry Pi 4 in this blogpost, which functioned just fine; although only with one user and little apps installed. I might do a follow up when I have used Nextcloud more extensively and explore different hardware options.
  - willis936 5y ago
    I switched from dropbox to nextcloud recently. I use pis for VPN gateways and DNS servers, but don't trust them for things like data storage. I host nextcloud via TrueNAS SCALE running on a dual E5 + 4x2TB NVMe. TrueNAS handles the docker images with a kubernetes cluster managed by middleware. Straying from default settings is a time-consuming path, but the defaults work great. Nextcloud doesn't feel perfect with lots of UI jank (initial photo upload was a real headache), but I trust the data put there will not delete itself. I love having the ability to selectively view and sync files with native OS explorers on windows, mac, and iOS. iOS photo backup with live photos is also something no other solution I've seen can compete with.
  - TheIronMark 5y ago
    > Raspberry Pi 4 Before everyone moved to cloud services, self-hosting was a goto choice for nerds who wanted their own stuff, including me. One challenge that self-hosting has not really conquered is availability. If your rpi dies, so does your self-hosting. You might want to explore (and blog about) setting-up a failover device. I'd definitely read about that.
teekert 5y ago
Nice, I did this too. It's brilliant as backend for my iPhone, except that they are not putting imagemagick into the docker image and so your .heic pictures have no thumbnails and you can't view them. Still looking for solution to that. One thing, you don't have to expose that mariadb port, all services in a docker-compose file are on the same network unless otherwise specified (and you can address them by their container name, build-in DNS!) :) Oh and you can super-power it by Using Traefik for https, you just need to add some stuff to your docker-compose.yaml file. Although OP mentions a reverse proxy already, outside of this compose file. I wrote a bit about this too with more detail, but I'm too afraid that HN will smash my poor Corei3 server :p. I want to get all of it on GitHub at some point, and then share it.
- neoglow 5y ago
  Hi Teekert! Thank you for your feedback; I will 'unexpose' the mariadb port in this example. That is one less service open for exploiting! :) I now about Traefik, but I use the Synology reverse proxy at the moment. I felt that it is not fair to include it in this blogpost, since it is not an open source solution and not truely in the spirit of selfhosting. I plan to make the switch in the future to another reverse proxy like Traefik, Caddy or maybe just Nginx, not sure yet. Could you give me the link to the blogpost? I might link to it :) Quality conten t must be shared and I think we as selfhosters should make it as approachable as possible for newcomers.
  - teekert 5y ago
    Actually Traefik is open source (right?): [0] I really have to think about the post and update it, perhaps I'll get back to you and put it on a vps, not on "the hub of my digital life", before I share it. Actually almost everything I learned and use I heard about on the Self-hosted podcast [1], and on one of the host's GitHub repos [2] (who takes personal infra as code to the next level). [0]: https://github.com/traefik/traefik/blob/master/LICENSE.md https://github.com/traefik/traefik/blob/master/LICENSE.md [1]: https://selfhosted.show/ https://selfhosted.show/ [2]: https://github.com/IronicBadger https://github.com/IronicBadger
encryptluks2 5y ago
I find NextCloud in itself to be pretty bloated and trying to do too many things with a lot of poor implementations. Syncthing is great for file syncing and there are a few good Cal/CardDAV options. I also find PHP applications incredibly frustrating compared to more simple tools. Vdirsync isn't perfect but being able to backup and sync across providers is awesome and I love that I can view/sync the files natively vs having to routinely backup an entire database and use specialized tools to examine contacts and calendar entries. I'm hopeful someone will release a simple Go CalDAV and CardDav server, or that someone will contribute to making official packages for CyrusIMAP.
- mxuribe 5y ago
  I don't know of any calDav, cardDav servers written in Go, but i have heard of the following popular servers: * https://radicale.org https://radicale.org - written in python. * https://sabre.io/baikal/ https://sabre.io/baikal/ - written in php...which i see that you are not so crazy about...but i note it only because it is quite solid reputation. I'm curious why would you want a calDav, cardDav server written in Go? Is it for scalability? Or, ease of deployment? I am not judging your preference at all; i'm genuinely curious? Also, separately, i first learned of cyrus imap from a blogpost that FastMail folks posted, but do not much about it (other than it is highly respected as a platform for mail, calendar, contacts)...Is it built in Go?
  - bklaasen 5y ago
    > i first learned of cyrus imap from a blogpost that FastMail folks posted, but do not much about it (other than it is highly respected as a platform for mail, calendar, contacts)...Is it built in Go? Cyrus predates Go by quite a while! The project started in 1994. It's implemented in C. https://en.m.wikipedia.org/wiki/Cyrus_IMAP_server https://en.m.wikipedia.org/wiki/Cyrus_IMAP_server
    - mxuribe 5y ago
      Oh wow, you're not kidding about predating Go by quite a while! :-) Thanks for sharing.
amaccuish 5y ago
Still don't understand how Android doesn't have built-in support for CardDAV/CalDAV. It's built-in on iPhone. And the built-in ActiveSync support has been left to wither and die.
- lucideer 5y ago
  It's surprising that it's built-in on iPhone (though unsurprising that e.g. the support built into iCloud is so poorly documented). Generally, supporting open interoperable standards that make switching providers easy is bad for business, so I'm generally a lot more surprised at where it is supported, rather than at where it isn't. FWIW I sync my Android data with my iPhone (personal -v- work devices) using the FDroid DAVx⁵ and ICSx⁵ apps, rather than the author's one-time export solution, and they seem to work ok.
  - neoglow 5y ago
    > Generally, supporting open interoperable standards that make switching providers easy is bad for business, so I'm generally a lot more surprised at where it is supported, rather than at where it isn't. Exactly this. Google makes it very, very easy to have everything synced to a Google account on Android devices: just log in and it just works. You contacts, mail and calendar are all immediately available on your new device. If they'd implement CalDAV in an easy manner, it would probably be a more viable option for less tech-savvy people. What the parent commenter said: from a business perspective it doesn't make sense to implement it. Fortunately there are some good, relatively simple to use apps available to implement it for us. >rather than the author's one-time export solution, and they seem to work ok. The reason why a simple one-time export was my go-to solution, is because I really don't want my data on Google's servers. In the blogpost I explain how to import the data to Nextcloud and use that as a 'single source of truth'. Other devices can then sync up to your nextcloud instance. I don't have an iPhone, so I'm not sure how/if this would work on iOS, but I am sure that it's possible to sync it up in a similar manner.
  - neurobashing 5y ago
    It's not surprising at all since Apple was foundational in the specs: https://datatracker.ietf.org/doc/html/rfc4791 https://datatracker.ietf.org/doc/html/rfc4791
iou 5y ago
I use nextcloud for my card and cal DAV, but I no longer need a lot of the other features of Nextcloud, has anyone else run something like https://radicale.org/v3.html https://radicale.org/v3.html on serverless or something?
- YXNjaGVyZWdlbgo 5y ago
  I run https://sabre.io/baikal/ https://sabre.io/baikal/ mainly because of the webinterface some merge errors on carddav are just easier to fix with an ui.
l72 5y ago
I've used Nextcloud for my Contacts and Calendar for several years now. Works great on my iphone and linux computers (evolution + gnome-contacts/gnome-calendar). I also use Nextcloud for my Notes/Task Lists (also works great with iphone and evolution), bookmarks, and recipe management. My only issue with Nextcloud, is I really with they had an LTS release with at least 2 years of support. I have to keep my server moving between major versions pretty much every 4-6 months (you can't skip versions), or the clients which tend to get auto updated (especially on iOS) stop supporting the older server versions.
omarhaneef 5y ago
hacker news is the perfect place to come to if you're thinking "is NextCloud the best solution here? Are there others?" because people will tell you. But looking at these comments, it seems as though NextCloud is, far and away, the preferred choice.
- YXNjaGVyZWdlbgo 5y ago
  It's just the pony that does it all there are better services just for cal/carddav or file syncing but then you have 5 services running instead of 1.
  - flas9sd 5y ago
    the popularity is deserved as there exist adjacent apps and community forums for help. The minimal chat/webrtc solution "Talk" is great for family and friends, the (Android) Talk App itself made leaps last year. It will also write plaintext rows per chatline to the db, but that's okay. Things transferred via webdav can be clientside encrypted, cal- and carddav again is cleartext. Etesync can do it encrypted but then you'd leave the all-in-one package. It's even more fun with customroms having davx and a webdav sync solution already integrated.
mos_6502 5y ago
I landed on a similar approach. Nextcloud is heavy for my purposes, but integrating everything into one service has benefits. The only feature I miss from Radicale is the built-in support for versioning in Git. It's definitely handy to keep track of/roll back changes to my calendars, contacts, todos, etc on the server. I wrote a small script [1] that periodically syncs changes from my Nextcloud cal/cardDAV feeds into a Git repository. Sharing it here as a bonus in case it's useful to others. [1] https://blog.ctis.me/2021/12/31/nextcloud-backer-upper/ https://blog.ctis.me/2021/12/31/nextcloud-backer-upper/
amiraliakbari 5y ago
Just today, I received a text message from Google that my account has been disabled. The stated reason is "Spamming". I've been actively using this account as my main email for more than 14 years - back when you Gmail was intive-only. I rarely send any emails, and I'm sure my accounts has sent less than 50 emails in the past year. I don't know how an account with so few sent emails can be marked as spammer by any AI. But it was just the last day that I read the tweet saying files containing a "1" are marked as copyright infringement, so I shouldn't be so surprised. Like the author I've also seen many such horror stories before, but always thought that wouldn't happen to me. I'm setting up my new email address on my own domain now, and encourage everyone to do the same. I'm still waiting for my appeal, so have not yet exactly checked how many sites I've lost access to because of Google login. Anyways, I will not make the mistake of using Google login or an email with domain not under my control for registering on any site again, even the least important ones.
- caseysoftware 5y ago
  I worked for an identity company for years and preached the dangers of social auth.. especially when there is little chance/process for appeal. If Google kills your account, gmail and youtube are gone. Every social auth account is frozen. No clue what happens to your Android devices but your Play purchases are gone. Your Google Voice number disappears. It's a bad place to be. The story isn't any different for Facebook (Whatsapp, Instagram, Occulus), Apple (icloud, app store), and many many others. And even then, I'm starting to see the same dangers for any centralized auth provider.
  - Spivak 5y ago
    Social auth isn't that much better than email auth which is what social auth replaces. If you lose your primary @gmail there goes your accounts to everything. Some services let you change your email but most don't and your email is your account. Having all your accounts exist in a dead-man walking state isn't that much better.
    - vorpalhex 5y ago
chaxor 5y ago
This is great. I noticed however that they mention that getting kicked off of Google (which apparently is happening *A LOT* now, as nearly every day there's been multiple HN posts stating they have been locked out) - and this is the (much needed) thrust towards self hosting these services. However, I noticed they left out making a mail solution. This is important and shows just how enormous of an opportunity there is in this space to make a quick, easy simple, self hosted mail solution. Any protonmail-like self hosted *simple* solutions out there?
- sharikous 5y ago
  The issue with mail is that it is supposed to be a reliable service where people can contact you on a multi-year or multi-decade span. Sure it is fun to self host mail in your Raspberry in the garage. But for many people the reliability of standard providers is a necessity. And that's even without accounting the anti spam filters
- l72 5y ago
  While it isn't hosting your own mail, Nextcloud does have some nice webmail interfaces, like rainloop, that can be configured using any imap/smtp server, like a desktop mail application. My hosting provider has hosted my email for 15+ years (with my own domain), but their webmail isn't super great, especially for my non-techy family. They mostly use the mail app on their iphone, but Rainloop through nextcloud made it really easy for them to check through the web.
- neoglow 5y ago
  Author here. I have had some suggestions for this, because of this post. I have experimented a little, but I first want to fully understand what is going on in the mail landscape. I want to write a beginner friendly guide on selfhosted mail in the future, so if you happen to have some tips, or things you want to know about, let me know!
francis-io 5y ago
I tried to set Nextcloud up with Collabora a while ago with docker. The connection was not obvious and had many issues with SSL, networking and DNS. The examples they provide still need a lot of tweaking. Setting up the right Traefik labels was also a big trial and error. Performance on document editing was a little laggy as well. Its really noticeable when your cursor lags behind what you type. I'd love if the great folks over at NextCloud could focus on the following, which would really ease adoption: * A polished, extensive example of a deployment in docker with all the bells and whistles (Collabora, cron, backups) * An env var / config file way to link and setup collabora with nextcloud. No more installing from a gui and typing in endpoints. Please let me config manage this as code! * a more polished initial setup wizard. I remember getting errors trying to specify all the env vars needed to set up the database. It wasn't obvious what was missing. * A polished config for common proxies. Traefik is the obvious choice for docker I think. I don't want this to come across wrong, I think the Nextcloud project is great! I feel like they could add a little time to the things mentioned above and give it a fantastic on-boarding experience.
- bj-rn 5y ago
  Check out NextCloudPi [1] I have their docker image [2] running on a Qnap Nas for about three years now without any hickups. [1] https://github.com/nextcloud/nextcloudpi https://github.com/nextcloud/nextcloudpi [2] https://hub.docker.com/r/ownyourbits/nextcloudpi https://hub.docker.com/r/ownyourbits/nextcloudpi
- jmnicolas 5y ago
  > Performance on document editing was a little laggy as well. What was the hardware behind? Was it local or in the cloud?
- agentdrtran 5y ago
  Cloudron.io will do all of the setup and hard parts for you - well worth the price in my opinion.
mythrwy 5y ago
I've found NextCloud a little buggy. OwnCloud seemed a lot more stable (used it for years). NextCloud has more features and is more secure I guess? But sometimes stuff doesn't work quite right. Auto Upload for phone for instance is hit and miss. It does seem there are less bugs over the past year or so or maybe I'm just learning to deal with it, but it does seem OwnCloud was more stable.
vanous 5y ago
Export into vcard will cause loss of contact photos. Google takeout saves the photos as extra files (you don't want to have to re-add them manually). The easiest way to move contacts between accounts I have found is with cardbook for Thunderbird. https://addons.thunderbird.net/en-US/thunderbird/addon/cardbook/ https://addons.thunderbird.net/en-US/thunderbird/addon/cardb...
- thepra 5y ago
  interesting, thanks for the tip
hallihax 5y ago
I recently set up NextCloud on a Raspberry Pi and found the process a little more convoluted than I would have liked - but that was mostly because the linuxserver.io image for MariaDB seemed to have some problems during database initialisation which I couldn't figure out. I switched over to use the yobasystems/alpine-mariadb image and that worked flawlessly. I haven't tried syncing contacts or calendar yet but that wasn't really my primary motivation - I just wanted self-hosted files with a nice interface. The NextCloud UX is a little clunky imo but I'm not complaining - it's a great piece of software especially considering the price tag! I also am trying to do open-source everything so it is very attractive in that regard.
zhenbo_endle 5y ago
Thank you for sharing it! I'll try to migrate all my contact and calendar data from Google and iCloud into a personal hosted server. Please let me ask a question - does anyone tried to access these data from Thunderbird, or any open-source email client? Thank you.
- thepra 5y ago
  yep, through cloudsync addon I manage the calendar in Thunderbird and sync contacts as well.

219 points by neoglow 5y ago

I did this move about a year ago, in addition I also moved my email from Gmail to a self hosted instance of Mail-in-a-Box. I never had any issues with either NextCloud or Mail-in-a-Box, I'm pretty happy about those.

neoglow 5y ago
Interesting; I am quite hesitant to move from Protonmail to a selfhosted mail. How long have you been selfhosting your mail? How do you deal with spam? Are your mails always received at the other end? Love to hear about this!
- _a9 5y ago
  I moved to selfhosting email about 2 years ago from google gsuite. I use mailcow[1] and have it on Hetzner Cloud. I don't send much but they have always gotten to their destination. Spam is very minimal, next to zero. Mailcow has built in spam detection with rspamd and lets you train it if any spam does get through just by moving the email to your junk folder. Another big thing I love about mailcow is that it has sync jobs so I can create mailbox's within it and have it sync my emails from other gmail accounts I have or really any mail host that you can connect to with IMAP. You can even set it so it deletes the email on the source account, which is great as most of my extra gmail accounts are just used to receive. The dashboard is pretty great too and you only really need to use the shell, apart from the initial install, to update it every now and then. So many great things I have to say about it and how you can super power it like hosting custom domains and nextcloud among other things. I'm glad I made the change to selfhost. If you know what you're doing I'd 100% recommend you test out running your own mail server for a bit to test the waters. 1: https://mailcow.email/ https://mailcow.email/
  - neoglow 5y ago
    Thank you for taking the time to share your experiences. Will definitely check this out!
  - mongol 5y ago
    What does your mail solution cost you, per month?
    - _a9 5y ago
      Late reply but it's around 15 euro. I'm using the CPX31 on Hetzner Cloud[1]. It holds my main setup and the extras like nextcloud, custom domains, etc. https://www.hetzner.com/cloud https://www.hetzner.com/cloud
- deleted 5y ago
  [deleted]
- dqv 5y ago
  Not the person you’re replying to, but I’ve been running MIAB (mailinabox) for business and personal since 2016. I haven’t seen any major issues with deliverability but YMMV. You have to register with all the feedback loops. Once you do, you get feedback when something you send gets marked as spam. Spam on MIAB is handled with postgrey and with spamassasin. It’s pretty good, although I’ve had recent issues with spam coming from gmail and hotmail. I’ve also customized some of the config to bounce Microsoft Sharepoint and Google Docs since neither companies control spam coming from their networks.
- ajosh 5y ago
  I'm self hosting with mail-in-a-box as well. It comes with a nextcloud install. It hasn't been flawless but it's been good and I'm happy to have some control. With e-mail, I haven't had any problems with one exception. When e-mailing the local school system, they reject my e-mails. I looked into it and it turns out that their spam provider was blocking me because I was a private domain or something like that. It was a configuration on their side. Their tech support told me that I should "get an e-mail address with a normal extension." Outside of that issue, my e-mails have gotten delivered. Between graylisting and the built-in spam filter software, I haven't had any spam issues. It's been smooth as far as that goes. The webmail (roundcube) isn't as nice as gmail but desktop and mobile clients are good in any event. The mail-in-a-box nextcloud install does use sqlite which means that you should make sure to backup contacts in case sqlite breaks. It broke for me once but I was able to copy my contacts from Thunderbird back into the system without any real problems. Calendaring works pretty well with Nextcloud but I haven't found any calendar software that I really love. The web software is good but not super fast. Lightning has gotten better but still feels bolted on. Kontact calendar is too groupware-oriented for my personal use. Evolution never quite felt right to me. The built-in Apple calendar and Samsung (Andriod) calendar apps work fairly well.
- mastazi 5y ago
  I self-host on a small-ish VPS. I don't really have to deal with spam, mail-in-a-box comes with pre-configured spamassassin. I haven't had issues with deliverability. When I created the box I did a scan of the IP and domain, found out that one antispam provider was blocking my IP, I sent a request to unblock it explaining this is my new IP I just acquired, they unblocked it. That was the last time I had to deal with deliverability issues, in any case I have an automated warning that I set up on MxToolBox. Let me know if you have more questions.
- justsomehnguy 5y ago
  > Love to hear about this Not quite the same question you've asked, but I found (since 2014) what you can host anything if you front it with FastMail. Ping me if you interested, currently on mobile (and in the bar).

estaseuropano 5y ago

What i miss un articles like this is the server/hardware choice and reasoning for it. The instructions how to setup nextcloud are on the nextcloud homepage, so no reason to repeat them.

neoglow 5y ago
Author of the blogpost. Thank you for your feedback. The problem with hardware choice, is that many selfhosters have really low-power, budget, powersaving hardware, including myself. The point of this article was for me to discover how I could move some of my data away from Google, of which this is one piece. I had this running on a Raspberry Pi 4 in this blogpost, which functioned just fine; although only with one user and little apps installed. I might do a follow up when I have used Nextcloud more extensively and explore different hardware options.
- willis936 5y ago
  I switched from dropbox to nextcloud recently. I use pis for VPN gateways and DNS servers, but don't trust them for things like data storage. I host nextcloud via TrueNAS SCALE running on a dual E5 + 4x2TB NVMe. TrueNAS handles the docker images with a kubernetes cluster managed by middleware. Straying from default settings is a time-consuming path, but the defaults work great. Nextcloud doesn't feel perfect with lots of UI jank (initial photo upload was a real headache), but I trust the data put there will not delete itself. I love having the ability to selectively view and sync files with native OS explorers on windows, mac, and iOS. iOS photo backup with live photos is also something no other solution I've seen can compete with.
- TheIronMark 5y ago
  > Raspberry Pi 4 Before everyone moved to cloud services, self-hosting was a goto choice for nerds who wanted their own stuff, including me. One challenge that self-hosting has not really conquered is availability. If your rpi dies, so does your self-hosting. You might want to explore (and blog about) setting-up a failover device. I'd definitely read about that.

teekert 5y ago

Nice, I did this too. It's brilliant as backend for my iPhone, except that they are not putting imagemagick into the docker image and so your .heic pictures have no thumbnails and you can't view them. Still looking for solution to that. One thing, you don't have to expose that mariadb port, all services in a docker-compose file are on the same network unless otherwise specified (and you can address them by their container name, build-in DNS!) :) Oh and you can super-power it by Using Traefik for https, you just need to add some stuff to your docker-compose.yaml file. Although OP mentions a reverse proxy already, outside of this compose file. I wrote a bit about this too with more detail, but I'm too afraid that HN will smash my poor Corei3 server :p. I want to get all of it on GitHub at some point, and then share it.

neoglow 5y ago
Hi Teekert! Thank you for your feedback; I will 'unexpose' the mariadb port in this example. That is one less service open for exploiting! :) I now about Traefik, but I use the Synology reverse proxy at the moment. I felt that it is not fair to include it in this blogpost, since it is not an open source solution and not truely in the spirit of selfhosting. I plan to make the switch in the future to another reverse proxy like Traefik, Caddy or maybe just Nginx, not sure yet. Could you give me the link to the blogpost? I might link to it :) Quality conten t must be shared and I think we as selfhosters should make it as approachable as possible for newcomers.
- teekert 5y ago
  Actually Traefik is open source (right?): [0] I really have to think about the post and update it, perhaps I'll get back to you and put it on a vps, not on "the hub of my digital life", before I share it. Actually almost everything I learned and use I heard about on the Self-hosted podcast [1], and on one of the host's GitHub repos [2] (who takes personal infra as code to the next level). [0]: https://github.com/traefik/traefik/blob/master/LICENSE.md https://github.com/traefik/traefik/blob/master/LICENSE.md [1]: https://selfhosted.show/ https://selfhosted.show/ [2]: https://github.com/IronicBadger https://github.com/IronicBadger

encryptluks2 5y ago

I find NextCloud in itself to be pretty bloated and trying to do too many things with a lot of poor implementations. Syncthing is great for file syncing and there are a few good Cal/CardDAV options. I also find PHP applications incredibly frustrating compared to more simple tools. Vdirsync isn't perfect but being able to backup and sync across providers is awesome and I love that I can view/sync the files natively vs having to routinely backup an entire database and use specialized tools to examine contacts and calendar entries. I'm hopeful someone will release a simple Go CalDAV and CardDav server, or that someone will contribute to making official packages for CyrusIMAP.

mxuribe 5y ago
I don't know of any calDav, cardDav servers written in Go, but i have heard of the following popular servers: * https://radicale.org https://radicale.org - written in python. * https://sabre.io/baikal/ https://sabre.io/baikal/ - written in php...which i see that you are not so crazy about...but i note it only because it is quite solid reputation. I'm curious why would you want a calDav, cardDav server written in Go? Is it for scalability? Or, ease of deployment? I am not judging your preference at all; i'm genuinely curious? Also, separately, i first learned of cyrus imap from a blogpost that FastMail folks posted, but do not much about it (other than it is highly respected as a platform for mail, calendar, contacts)...Is it built in Go?
- bklaasen 5y ago
  > i first learned of cyrus imap from a blogpost that FastMail folks posted, but do not much about it (other than it is highly respected as a platform for mail, calendar, contacts)...Is it built in Go? Cyrus predates Go by quite a while! The project started in 1994. It's implemented in C. https://en.m.wikipedia.org/wiki/Cyrus_IMAP_server https://en.m.wikipedia.org/wiki/Cyrus_IMAP_server
  - mxuribe 5y ago
    Oh wow, you're not kidding about predating Go by quite a while! :-) Thanks for sharing.

amaccuish 5y ago

Still don't understand how Android doesn't have built-in support for CardDAV/CalDAV. It's built-in on iPhone. And the built-in ActiveSync support has been left to wither and die.

lucideer 5y ago
It's surprising that it's built-in on iPhone (though unsurprising that e.g. the support built into iCloud is so poorly documented). Generally, supporting open interoperable standards that make switching providers easy is bad for business, so I'm generally a lot more surprised at where it is supported, rather than at where it isn't. FWIW I sync my Android data with my iPhone (personal -v- work devices) using the FDroid DAVx⁵ and ICSx⁵ apps, rather than the author's one-time export solution, and they seem to work ok.
- neoglow 5y ago
  > Generally, supporting open interoperable standards that make switching providers easy is bad for business, so I'm generally a lot more surprised at where it is supported, rather than at where it isn't. Exactly this. Google makes it very, very easy to have everything synced to a Google account on Android devices: just log in and it just works. You contacts, mail and calendar are all immediately available on your new device. If they'd implement CalDAV in an easy manner, it would probably be a more viable option for less tech-savvy people. What the parent commenter said: from a business perspective it doesn't make sense to implement it. Fortunately there are some good, relatively simple to use apps available to implement it for us. >rather than the author's one-time export solution, and they seem to work ok. The reason why a simple one-time export was my go-to solution, is because I really don't want my data on Google's servers. In the blogpost I explain how to import the data to Nextcloud and use that as a 'single source of truth'. Other devices can then sync up to your nextcloud instance. I don't have an iPhone, so I'm not sure how/if this would work on iOS, but I am sure that it's possible to sync it up in a similar manner.
- neurobashing 5y ago
  It's not surprising at all since Apple was foundational in the specs: https://datatracker.ietf.org/doc/html/rfc4791 https://datatracker.ietf.org/doc/html/rfc4791

iou 5y ago

I use nextcloud for my card and cal DAV, but I no longer need a lot of the other features of Nextcloud, has anyone else run something like https://radicale.org/v3.html https://radicale.org/v3.html on serverless or something?

YXNjaGVyZWdlbgo 5y ago
I run https://sabre.io/baikal/ https://sabre.io/baikal/ mainly because of the webinterface some merge errors on carddav are just easier to fix with an ui.

l72 5y ago

I've used Nextcloud for my Contacts and Calendar for several years now. Works great on my iphone and linux computers (evolution + gnome-contacts/gnome-calendar). I also use Nextcloud for my Notes/Task Lists (also works great with iphone and evolution), bookmarks, and recipe management. My only issue with Nextcloud, is I really with they had an LTS release with at least 2 years of support. I have to keep my server moving between major versions pretty much every 4-6 months (you can't skip versions), or the clients which tend to get auto updated (especially on iOS) stop supporting the older server versions.

omarhaneef 5y ago

hacker news is the perfect place to come to if you're thinking "is NextCloud the best solution here? Are there others?" because people will tell you. But looking at these comments, it seems as though NextCloud is, far and away, the preferred choice.

YXNjaGVyZWdlbgo 5y ago
It's just the pony that does it all there are better services just for cal/carddav or file syncing but then you have 5 services running instead of 1.
- flas9sd 5y ago
  the popularity is deserved as there exist adjacent apps and community forums for help. The minimal chat/webrtc solution "Talk" is great for family and friends, the (Android) Talk App itself made leaps last year. It will also write plaintext rows per chatline to the db, but that's okay. Things transferred via webdav can be clientside encrypted, cal- and carddav again is cleartext. Etesync can do it encrypted but then you'd leave the all-in-one package. It's even more fun with customroms having davx and a webdav sync solution already integrated.

mos_6502 5y ago

I landed on a similar approach. Nextcloud is heavy for my purposes, but integrating everything into one service has benefits. The only feature I miss from Radicale is the built-in support for versioning in Git. It's definitely handy to keep track of/roll back changes to my calendars, contacts, todos, etc on the server. I wrote a small script [1] that periodically syncs changes from my Nextcloud cal/cardDAV feeds into a Git repository. Sharing it here as a bonus in case it's useful to others. [1] https://blog.ctis.me/2021/12/31/nextcloud-backer-upper/ https://blog.ctis.me/2021/12/31/nextcloud-backer-upper/

amiraliakbari 5y ago

Just today, I received a text message from Google that my account has been disabled. The stated reason is "Spamming". I've been actively using this account as my main email for more than 14 years - back when you Gmail was intive-only. I rarely send any emails, and I'm sure my accounts has sent less than 50 emails in the past year. I don't know how an account with so few sent emails can be marked as spammer by any AI. But it was just the last day that I read the tweet saying files containing a "1" are marked as copyright infringement, so I shouldn't be so surprised. Like the author I've also seen many such horror stories before, but always thought that wouldn't happen to me. I'm setting up my new email address on my own domain now, and encourage everyone to do the same. I'm still waiting for my appeal, so have not yet exactly checked how many sites I've lost access to because of Google login. Anyways, I will not make the mistake of using Google login or an email with domain not under my control for registering on any site again, even the least important ones.

caseysoftware 5y ago
I worked for an identity company for years and preached the dangers of social auth.. especially when there is little chance/process for appeal. If Google kills your account, gmail and youtube are gone. Every social auth account is frozen. No clue what happens to your Android devices but your Play purchases are gone. Your Google Voice number disappears. It's a bad place to be. The story isn't any different for Facebook (Whatsapp, Instagram, Occulus), Apple (icloud, app store), and many many others. And even then, I'm starting to see the same dangers for any centralized auth provider.
- Spivak 5y ago
  Social auth isn't that much better than email auth which is what social auth replaces. If you lose your primary @gmail there goes your accounts to everything. Some services let you change your email but most don't and your email is your account. Having all your accounts exist in a dead-man walking state isn't that much better.
  - vorpalhex 5y ago

chaxor 5y ago

This is great. I noticed however that they mention that getting kicked off of Google (which apparently is happening *A LOT* now, as nearly every day there's been multiple HN posts stating they have been locked out) - and this is the (much needed) thrust towards self hosting these services. However, I noticed they left out making a mail solution. This is important and shows just how enormous of an opportunity there is in this space to make a quick, easy simple, self hosted mail solution. Any protonmail-like self hosted *simple* solutions out there?

sharikous 5y ago
The issue with mail is that it is supposed to be a reliable service where people can contact you on a multi-year or multi-decade span. Sure it is fun to self host mail in your Raspberry in the garage. But for many people the reliability of standard providers is a necessity. And that's even without accounting the anti spam filters
l72 5y ago
While it isn't hosting your own mail, Nextcloud does have some nice webmail interfaces, like rainloop, that can be configured using any imap/smtp server, like a desktop mail application. My hosting provider has hosted my email for 15+ years (with my own domain), but their webmail isn't super great, especially for my non-techy family. They mostly use the mail app on their iphone, but Rainloop through nextcloud made it really easy for them to check through the web.
neoglow 5y ago
Author here. I have had some suggestions for this, because of this post. I have experimented a little, but I first want to fully understand what is going on in the mail landscape. I want to write a beginner friendly guide on selfhosted mail in the future, so if you happen to have some tips, or things you want to know about, let me know!

francis-io 5y ago

I tried to set Nextcloud up with Collabora a while ago with docker. The connection was not obvious and had many issues with SSL, networking and DNS. The examples they provide still need a lot of tweaking. Setting up the right Traefik labels was also a big trial and error. Performance on document editing was a little laggy as well. Its really noticeable when your cursor lags behind what you type. I'd love if the great folks over at NextCloud could focus on the following, which would really ease adoption: * A polished, extensive example of a deployment in docker with all the bells and whistles (Collabora, cron, backups) * An env var / config file way to link and setup collabora with nextcloud. No more installing from a gui and typing in endpoints. Please let me config manage this as code! * a more polished initial setup wizard. I remember getting errors trying to specify all the env vars needed to set up the database. It wasn't obvious what was missing. * A polished config for common proxies. Traefik is the obvious choice for docker I think. I don't want this to come across wrong, I think the Nextcloud project is great! I feel like they could add a little time to the things mentioned above and give it a fantastic on-boarding experience.

bj-rn 5y ago
Check out NextCloudPi [1] I have their docker image [2] running on a Qnap Nas for about three years now without any hickups. [1] https://github.com/nextcloud/nextcloudpi https://github.com/nextcloud/nextcloudpi [2] https://hub.docker.com/r/ownyourbits/nextcloudpi https://hub.docker.com/r/ownyourbits/nextcloudpi
jmnicolas 5y ago
> Performance on document editing was a little laggy as well. What was the hardware behind? Was it local or in the cloud?
agentdrtran 5y ago
Cloudron.io will do all of the setup and hard parts for you - well worth the price in my opinion.

mythrwy 5y ago

I've found NextCloud a little buggy. OwnCloud seemed a lot more stable (used it for years). NextCloud has more features and is more secure I guess? But sometimes stuff doesn't work quite right. Auto Upload for phone for instance is hit and miss. It does seem there are less bugs over the past year or so or maybe I'm just learning to deal with it, but it does seem OwnCloud was more stable.

vanous 5y ago

Export into vcard will cause loss of contact photos. Google takeout saves the photos as extra files (you don't want to have to re-add them manually). The easiest way to move contacts between accounts I have found is with cardbook for Thunderbird. https://addons.thunderbird.net/en-US/thunderbird/addon/cardbook/ https://addons.thunderbird.net/en-US/thunderbird/addon/cardb...

thepra 5y ago
interesting, thanks for the tip

hallihax 5y ago

I recently set up NextCloud on a Raspberry Pi and found the process a little more convoluted than I would have liked - but that was mostly because the linuxserver.io image for MariaDB seemed to have some problems during database initialisation which I couldn't figure out. I switched over to use the yobasystems/alpine-mariadb image and that worked flawlessly. I haven't tried syncing contacts or calendar yet but that wasn't really my primary motivation - I just wanted self-hosted files with a nice interface. The NextCloud UX is a little clunky imo but I'm not complaining - it's a great piece of software especially considering the price tag! I also am trying to do open-source everything so it is very attractive in that regard.

zhenbo_endle 5y ago

Thank you for sharing it! I'll try to migrate all my contact and calendar data from Google and iCloud into a personal hosted server. Please let me ask a question - does anyone tried to access these data from Thunderbird, or any open-source email client? Thank you.

thepra 5y ago
yep, through cloudsync addon I manage the calendar in Thunderbird and sync contacts as well.