6 ms·
What's a good replacement for Google Apps in a NSA-poisoned post-cloud era?
These days, anyone who values their privacy are probably considering migrating away from US-based cloud-services... In an age of NSA masss-surveilance and service-providers getting hit with secret requests for information, it seems the only thing you can actually trust is open-source software you host yourself.<p>Does anyone have a good guide or experience moving from cloud-services like Google apps to a completely self-hosted open-source solution for email, contact-management and calendering? What about productivity tools?<p>Can you make all of this (more or less) seamlessly integrate with mobile-platforms?
- josteink 13y agoAs for mobile platforms, iOS is obviously not a trust-worthy solution. Android is OK, but has issues by being run by Google and core services provided through them. I'd love for a third viable option to pop up, but for the same reasons as iOS, Windows Phone is out. FirefoxOS seems not quite ready at this point, and until proven otherwise I will consider Tizen vaporware. That pretty much leaves us with Android. While owned by Google is at least open-source. If you go super-paranoid you can always make/get builds not integrating with Google's services in any way. Does anyone have any experience with making opens-source solutions for things like email, calendering and contact-management integrate nicely with Android?
- mtgx 13y agoBest would be to use a CyanogenMod ROM. I hear in the next version they plan to introduce some extra privacy options: http://www.androidcentral.com/easy-privacy-may-be-coming-soon-cyanogenmod-incognito-mode http://www.androidcentral.com/easy-privacy-may-be-coming-soo... Then TextSecure for SMS/chat, RedPhone for calling, and some other alternatives you may find for other apps. At least for now it might even help if you use services from small, unknown companies, as opposed to services from the big ones, which are a given to be the focus of NSA. But it may be a matter of time before they collect the data (even if encrypted) from those, too, if they aren't already. It would also help a bit to user services hosted in other countries.
- shirederby 13y agoThe flip-side of relying on smaller companies, of course, is they may not have the cash available to challenge specious searches that a company like Google does -- assuming it wants to challenge requests, of course. Then again, from what we know about the FISC it's hard to say whether legal challenges make much difference.
- ams6110 13y agoIt would also help a bit to user services hosted in other countries. How so? At least in theory the constitution applies to US citizens and US companies. With a foreign service you have no such claim. Historically the NSA has always been concerned with communication into and out of the US, so if you live the US and use foreign hosting you're essentially stepping right into their spotlight. Also you can guess that most other governments snoop as much if not more so than the NSA does. It's just the nature of the beast.
- steveklabnik 13y agoCell phones inherently give away your location all the time. And there's some evidence to suggest that their speakers can be turned on remotely. The only way to have privacy and a cell phone is to leave it at home.
- jaxbot 13y ago> And there's some evidence to suggest that their speakers can be turned on remotely [citation needed] (and wanted, since I'm curious)
- steveklabnik 13y agoI know this mostly through activist oral histories, but here's one story: http://www.zdnet.com/news/fbi-taps-cell-phone-mic-as-eavesdropping-tool/150467 http://www.zdnet.com/news/fbi-taps-cell-phone-mic-as-eavesdr...
- Zigurd 13y agoThe other response to your question cites the case where the capability leaked. The other reason to think this capability is in phones is that the source code for firmware for mobile baseband processors is a closely guarded secret. Also, the audio paths for voice calls is controlled by the firmware in this processor. So if your phone is a bug, this is where that would be implemented. If you search for words "mobile baseband fuzzing" you will find that many people have sought to satisfy their curiosity about this part of a phone.
- mbreese 13y agoIf you're truly paranoid about it, you could keep you phone in a Faraday cage or something like a Mylar bag to block all external signals. But that would really only be for those moments when you want to be off grid. That would otherwise defeat the purpose of having a phone.
- t-ipecac 13y agoThis is a good guide for setting up self-hosted email: http://flurdy.com/docs/postfix/ http://flurdy.com/docs/postfix/ Owncloud is ok for self-hosted file hosting. It's a little buggy still, but is improving very quickly. It also has Android and desktop apps. Although Owncloud has contacts/calendar built in, Radicale is more polished and has more features. It's also easy to set up. Make sure you get the latest version through pip rather than your distros package manager. On Android you can then use CardDav Sync / CalDav Sync to sync calendars and contacts.
- Zigurd 13y agoDon't confuse commercial prospects with usefulness. Although Tizen, FirefoxOS, and Jolla all have OEM and carrier commitments for a roll-out (Ubuntu? Anyone know?) they have a tough task ahead to gain acceptance. But that doesn't reduce their usefulness as systems that might be more open in practice than Android. It is likely that some of the new-generation open mobile OSs could enable you to build and install your phone's OS more conveniently than Android. That might enable you to do encrypted voice more readily. And that might push Google to provide more confidence-building for Android.
- saalweachter 13y ago1. Use an email client with end-to-end encryption. 2. Buy a notebook. They sell ones that have a calendar in the front and an address book in the back. 3. Use a stamp and an envelope. The USPO does not keep a record of all sent or received packages. Public drop boxes are also widely available, PO boxes which mask your identity from the sender, and third party mailboxes to mask your identity from The Man. I mean, really, if you're going to send messages to your mistress, girlfriend, lover, or wife, at least have the class to send paper letters she can keep in a lockbox for her great-grandchildren to find after she's dead.
- QUFB 13y agoThe USPO does not keep a record of all sent or received packages. I'm not sure that's true. JUNE 7--A high-tech computer system that captures images of “every mail piece that is processed” by the United State Postal Service was critical in helping federal agents track the Texas woman arrested today for allegedly sending ricin-tainted letters to President Barack Obama and New York City Mayor Michael Bloomberg. http://www.thesmokinggun.com/documents/woman-arrested-for-obama-bloomberg-ricin-letters-687435 http://www.thesmokinggun.com/documents/woman-arrested-for-ob...
- ErsatzVerkehr 13y agoMail (i.e. the envelope) is scanned for address decoding. I believe the orange barcode is an index into the database of mail pieces and associated decoded address. Although this has a completely legitimate rationale in facilitating the delivery of the mail, it's easy to see that the scanned images and mailpiece database could be archived for much longer than is needed for mail delivery only.
- deleted 13y ago[deleted]
- saalweachter 13y agoThen I stand corrected! One of the memes floating around was that snail mail was less tracked. I wonder if I assumed this applied to the metadata and people were only ever referring to the contents.
- coopdog 13y agoIt doesn't quite answer the question but I've been thinking something like Open Stack could be the future. You write your cloud apps for open stack, then the user can select where they deploy it, be it in a family/community set of open stack compatible servers, corporate servers or some trusted local open stack service.
- danso 13y agoIf you're concerned that the NSA will catch you in their dragnet...why are you using cloud-services at all? To sync data with your mobile device? But doesn't the NSA already record all mobile transmissions? What difference to the NSA intercept program does it make if the data comes from Google Apps or your own open-source platform? Would you still rely on cloud services for collaborative apps? Well, besides the issue of whether or not the NSA is catching all data packets sent through the fiber...you still have the weak point of any one of your collaborators receiving and transmitting information insecurely. So if the NSA is a main concern for you, why are you storing portable data in anything else but a large flash memory key that you can use for any of your devices on the road?
- josteink 13y agoThe nsa only collects information I send them over the internet via us-based services. I live outside the US.
- danso 13y ago1. The people you collaborate with may use U.S. based servers and may otherwise leak your data, intentionally or unintentionally. 2. The NSA is not at all alone among national agencies tapping into their own country's tubes.
- brown9-2 13y agoNot true. The NSA takes advantage of any data from overseas that is routed into or through the US.
- simgidacav 13y agoI think that any chunk of running data has some probability of being intercepted, if this is the question.
- gnosis 13y agoI don't know what gave you this impression. The NSA are interested in any and all sources of information, and probably collect just as much or more of it from foreign sources than domestic ones. Yes, the recent media hoopla has been over the NSA collecting information on Americans in America. But that does not mean that the NSA is limited to collecting information in America. Quite the contrary. Historically, they have been more about collecting foreign intelligence abroad (ie. spying on the rest of the world). This reminds me of a quote: "You have a choice: you can live under US domestic policy or US foreign policy". If you think you're safe or exempt under either of them, you might have some surprises in store for you.
- jaxbot 13y agoHow about email in general? These days, one cannot simply host an SMTP server out of their home, without it being automatically blocked by the big guys (i.e. Gmail's servers block any non-approved sources, for spam reasons). Of course, email in general isn't secure, and there's no way of knowing what the recipient does with the message anyway, so this is a bit of a tricky problem.
- anizan 13y agoI know outlook.com wont block or more accurately auto assign mail to spam if your domain has spf enabled. Try this wizard for TXT record to assign to your DNS http://www.microsoft.com/mscorp/safety/content/technologies/senderid/wizard/ http://www.microsoft.com/mscorp/safety/content/technologies/...
- moreentropy 13y agoI'm in the process of moving more stuff to a self hosted server right now. Sadly, this is almost impossible if you're not a seasoned sysadmin or willing to learn a lot. My setup looks like this: Mail: Postfix/Dovecot/Roundcube Setting up a Mail server is the hardest part i think. It's essential to implement measures against spam and abuse. In my setup, this includes: - Get a valid certificate for your mail host and enable opportunistic TLS for SMTP and SMTPD. - Implement DKIM and SPF (and DMARC, http://dmarc.org/ http://dmarc.org/) - Use Blacklists: policyd-weight, but look out for changes to public RBL services - Reject Spam in the SMTP session using Milters, never bounce SPAM. - Use spamass-milter and clamav-milter to Filter unwanted stuff. - Use http://sanesecurity.com/ http://sanesecurity.com/ ClamAV signatures, in Debian use the clamav-unofficial-sigs package Instant Messaging: http://prosody.im/ http://prosody.im/ is a breeze to configure and it just works. Telephony / Video calls: Repro is a secure and simple SIP proxy: http://www.resiprocate.org/About_Repro http://www.resiprocate.org/About_Repro But: Resist the urge to install a VoIP PBX like Asterisk and connect it to your phone line & the internet. It will most likely be hacked and abused. Security: I've set up a self-signed CA using XCA (http://xca.sourceforge.net/ http://xca.sourceforge.net/). With a client certificate on a smart card which i embedded into a USB token (http://www.gemalto.com/products/usb_shell_token_v2/ http://www.gemalto.com/products/usb_shell_token_v2/), i can run around and plug this USB token in random machines and instantly have my client certificate available in Chrome. This is especially nice if you (like me) don't trust PHP software like the Roundcube Webmailer.
- daemon13 13y agoCan you point to some good tutorials for starting with XCA? The home (http://xca.sourceforge.net/ http://xca.sourceforge.net/) is quite overwhelming.
- moreentropy 13y agoI don't get most of the stuff myself. PKIs are overwhelming. There are thousands of flags you can set when creating a certificate it's not funny anymore. I did a lot of trial and error until i had a VPN using my certificates running successfully (that's what i needed the CA for in the first place). Maybe look for CA stuff in general or some TinyCA tutorial. I've used TinyCA, it's exactly the same complexity as XCA, although I like XCA's UI better.
- gnosis 13y agoThis is a great question, but you should bear in mind that there's almost always going to be a tradeoff between security/privacy/anonymity and convenience. Encypting your email and having to deal with key managment issues, and hosting your own email server is going to be more of a hassle than just using someone else's "free" cloud-based service. Setting up and managing your own services is going to be a burden and a time sink, even if you have the skills, knowledge, and copious free time to do it all. The question becomes: how much is your privacy and security worth to you? Unfortunately, for most people the answer is "not that much". Nevermind that most of them don't have the knowledge or skills to set up and manage their own services even if they valued their security and privacy enough to sacrifice so much time and effort to it. The problems are magnified when you consider that most applications are not built with security, privacy, or anonymity in mind. And when you have to use these applications to interact with other people (most of which probably won't be nearly as security or privacy conscious as you are), you're going to have an uphill battle to protect your own privacy. For instance, good luck getting your computer illiterate parents, friends, colleagues, and bosses to properly use GPG to encrypt their emails to you. This doesn't even begin to address the issues of privacy and security in the "real world" as opposed to the digital one, nor of the digital footprints you leave as you consume online information and media, and interact with others on various forums. The end result is that online privacy and security are largely becoming the mainstay of the super-paranoid technological elite and the ultra-rich, who can afford to hire security teams to take care of their privacy for them, and of the technological outcast, who (willingly or unwillingly) manages to avoid using the net at all.
- danso 13y agoI think you've approached the question in the right way. There is no such thing as security without a tradeoff...everyone who's ever traveled through an airport knows that. The cloud is useful because it's so easy to share things -- and that "leakiness" makes it inherently unsafe. The NSA had its own easy-access problem lately...Snowden reportedly snuck data out using USB drives, something that was purportedly banned after a 2008 virus incident...and yet, some sysop apparently thought it'd be a good idea to let a few USB ports survive, because the things are so damned useful. And now look at what that wrought the NSA. It's not just inconvenience that you have to put up when going for security, it's the risk that the inconvenience will cause you to enact blind spots to ease your day...and easing inconvenience was exactly the reason why people use cloud services (and USB keys) in the first place. I'm not trying to espouse fatalism (i.e. everyone just give up their data to the G-men). Just pointing out that what the OP wants is basically a unicorn.
- paul_f 13y agoA quick Google search turned up this: http://cipherdocs.com/ http://cipherdocs.com/
- amirmc 13y agoPart of the problem is that there aren't enough people building such things. We've all had the luxury of a 'free' offering, which can understandably stifle progression of alternatives. There are other challenges too. Decentralised services are probably the way forward but that creates a new set of problems around identity, communication and connectivity (things that are easier when everything just 'dials home'). User experience and design are also something that would have to be considered for such products before most people would/could switch. Keychain management will also be important to ensure security. Think of it like vaccines, where you need to have a certain proportion of the population inoculated before you can benefit from herd immunity [1]. If you're interested in a google-alternative that would deal with mail, contacts and calendars then get in touch with me (email in profile). There are a few of us who'll be building something and we'll need feedback. Despite all of the above, I'm pretty sure that Hotmail is still the biggest hosted email provider, followed by Yahoo and then Gmail. I can't remember where/when I heard this though. [1] http://en.wikipedia.org/wiki/Herd_immunity http://en.wikipedia.org/wiki/Herd_immunity
- deleted 13y ago[deleted]
- djim 13y agoYou're assuming they are getting the data from Google. They are getting the information from the internet backbone, not the service providers themselves. Assume EVERYTHING on the internet is being recorded, regardless of service provider. Setting up your own email solution does not even begin to solve the problem.
- awakeasleep 13y agoBetween 8 and 14 sysadmins.
- justinschuh 13y agoIgnoring the dubious baseline assumption that your data really is at risk of exposure, why do you think what you're proposing would make you safer rather than put you at more risk? You still need to actually home your servers somewhere, which means a colo or VPS that is subject to the exact same laws. Do you expect the providers of those services to have the capability to fight such requests better than Google, given that Google has a full time legal team dedicated to doing so? What about the basic security of the provider itself? Do you really expect that to be anywhere near the level of what Google provides on its own systems? To top it all off, there's the maintenance and securing of whatever you're actually running, which requires significant expertise and takes quite a bit of time if you don't want your box popped and turned into a zombie host (which is what is most likely to happen). I've actually done what you're proposing for several years, and I wouldn't recommend it to anyone. And I'm a well respected security professional with the right background who knows all the tricks I'm supposed to do. It was still a huge pain and time sink, which meant I often let patches and updates slide more than I should. The real cherry on top is that all the three different colo/VPS providers I've used were hacked at one point or another, causing disclosure of my personal data and significant outages of my ability to communicate. My point here is that you're not being honest with yourself if you really think you can manage this as a side project better than the full-time teams at Google do. If you want to pick another provider of email, etc, then investigate carefully and find one you're happy with. But I'd strongly discouraging running your own services.
- ef4 13y ago> You still need to actually home your servers somewhere, which means a colo or VPS that is subject to the exact same laws. Nobody is going to dispute that a colo box is still vulnerable to targeted surveillance. But targeted surveillance is not really the issue of the day. From the NSA's perspective, the expected value of obtaining your data is very small, but they'll bother doing it anyway when the cost is even smaller. Big centralized providers are very cost-effective targets. A sea of tiny servers operated by hundreds of different data centers, hosting heterogeneous applications, monitored by hundreds of different individuals and organizations are really not cost effective to surveil in bulk. (I agree with the rest of your post -- doing it yourself is a major pain, and no side-project is going to do a great job.)
- motters 13y agoI've been running my own web services for the last three years. For email I use exim/dovecot/roundcube and am also experimentally using Bitmessage For social networking I use Friendica, and eventually I'll be on the Red Matrix. For dropbox type functionality I either just use plain old ssh or Owncloud. Owncloud also includes a lot of other stuff such as photos and calendar. For blogging I use Flatpress. It just works. From a security point of view conventional email remains a problem. It's not yet possible to function in the modern world without email, and trying to persuade even quite technical people to use PGP/GPG routinely has been very unsuccessful, since it's just too inconvenient for most people. I've never used Google apps to any extent since I don't have much need to collaboratively edit documents. But if I did then there probably are open source systems out there which would do the job. Certainly if I was running a business then I wouldn't even contemplate using Google apps, especially after the recent NSA scandal. I expect that readers here are more than capable of doing all the above, but sadly the average internet user is still going to remain stuck in the surveillance state with few other options to turn to.
- igravious 13y agoI've been thinking about this in light of recent events. I was going to blog about it but I'll jot down my thoughts here. At the moment we have companies making all sorts of set-top boxes, games consoles and media boxes which come in all sorts of shapes and sizes. It seems to me that we can rely on corporations to build user friendly devices for us to consume media. What we (as citizens) rather than as consumers need is a comms box or a social box or whatever it gets called. Some mentioned "personal data box" on here or words to that effect. We want (I'm going out on a limb to speak for other around here) secure, federated and private communications: chat communication (instant messaging), mail communication (email), audio communication (voice over ip), video communication (video over ip). Also we'd ideally like our digital social interactions kept secure, federated and private. Finally secure and private online storage of documents would be nice if only for convenience. And to top it all off what would be super-delicious would be a workable single sign-on thingy for the internet age. Please, pretty please? We only have to solve this once. We're at the threshold of the digital age, future generations will thank us for solving these problems when the issues cam e to a head (as they are now). What is needed for all this is _open federated protocols_. And the corporations that flog proprietary offerings have to embrace these protocols. As far as I can see we have those protocols for email (smtp+tls+...?), for voice over ip (sip), chat (jabber?), social (open soical?), online document storage (?), single sign on (openid?) We need all this in a box that people can just connect to the net via their router using wifi or whatever. We need it to be peer to peer so that large portions of it cannot be bought out and centralized after the fact. We need to shout loudly when companies roll back on support of open protocols. We need this in a box. My personal social comms box. I dunno. It seems like a huge but vital need. But we only need to get it right once. We can't trust those in power not to abuse this tech, there will always be an erosion of checks and balances so we need to build a technical solution while we struggle for better social and legal norms. Who's with me?
- mseebach 13y agoIf you're e-mailing people on the public internet, you're leaking your contacts and patterns of correspondence anyway, even if you're using end-to-end encryption. Even if you're outside the US, it's near impossible to ensure your traffic won't cross through US controlled infrastructure at some point. That said, Zimbra does all of what you're after, it's "freemium" open source (meaning that it's a commercial product with a free community edition) and it was fairly easy to deal with last time I set it up 4-5 years ago, presumably it's better now.
- magoon 13y agoIt's possible for a company like Google or Yahoo to offer services without 1) requiring that we identify ourselves; 2) profiling us; 3) keeping detailed logs and data in a way that it can be mined and forklifted. They just all choose not to.
- forgotAgain 13y agoPeople seem very concerned about backdoors in Huawei equipment. Isn't it just as likely that there are backdoors in US manufactured equipment. If there is then there are two privacy solutions: end to end strong encryption, or become a hermit.
- gaetan 13y agoOne solution is to host your own NAS. Synology e.g. provide for their NAS multiple services that might replace some Google Apps: Mail server (Gmail), CalDAV support (Google Calendar), Cloud Station (Google Drive/Dropbox), Photo Station (Picasa), Audio Station (Google Play),… all these with VPN connections. And you can easily install some productivity tools like CRM, wiki, Wordpress, Zafara…
- pknight 13y agoIt doesn't come prepackaged with apache/php/mysql does it? I take it one would have to install those. Tonido does most of these things, but there are some limitations/complications when trying to install your own stuff I believe.
- sandstrom 13y agoI considered switching to Fast Mail a while ago, but never got around to it. It's owned by Opera Software, and hosted in Australia. I'd prefer if it was hosted in Norway (Opera is a Norwegian software company), but Australia feels like a better choice than the US (too me anyway, perhaps others can chime in). https://www.fastmail.fm/ https://www.fastmail.fm/
- venus 13y agoAustralia is a member of the UKUSA intelligence treaty, so you can assume your mail there is under broadly the same scrutiny as in the USA, if not more so. Frankly I wouldn't trust any commercially hosted mail service to be immune from government monitoring no matter where it's hosted.
- fastmailuser 13y agoAccording to https://en.wikipedia.org/wiki/FastMail.FM https://en.wikipedia.org/wiki/FastMail.FM its servers are located in New York City with a backup in Norway.
- calinet6 13y agoThis does not exist yet, but I've been thinking about it for a long time. I think we generally need to move away from a centralized cloud to a more distributed cloud, where you can host your own applications on your own server, encrypt and protect them as you like, and share them with whomever you need via a secure API. You can imagine having a photo app, a social networking app, video sharing apps, document apps, whatever people can build and deploy. You'd need standards. Standard web service APIs, standard authentication, standard privacy controls, standard database layer, standard encryption between nodes. And that would take most of the effort off the individual apps for handling all this. They'd just say "I have this chunk of data, and it's accessible to these people" and if the everything checks out, the app can grab it from whatever node it's on. There needs to be this sort of operating-system-for-the-web on which people can build distributed apps. Something like Diaspora is trying to be, but without the limited social networking overtones. A platform where security, privacy, distributed social networking, and sharing are the main concerns, and the apps built on top of it more general. It might be interesting. I've had this idea since about 2001 but never got around to building something. Maybe it's the right time...
- mehrzad 13y agoHave you seen this: https://arkos.io/ https://arkos.io/
- amirmc 13y ago> "There needs to be this sort of operating-system-for-the-web on which people can build distributed apps." There have been various research projects looking at exactly the things you describe. For example you can look over the work at http://perscon.net http://perscon.net (It's one I'm involved with, which I'll be commercialising in due course). It doesn't mention the distributed app piece but it is something we're thinking about. There are many other groups tackling this from different angles but (thankfully) discussions like these occasionally bring folks together. If you decide to build something, please do feel free to get in touch (email in profile). I'd be very happy to alpha test or give feedback.
- ErsatzVerkehr 13y agoYour idea sounds a lot like "the internet".
- seferphier 13y agoRelated topic: http://prism-break.org/ http://prism-break.org/ Replace your workflow with open-source tools that aren't attached to Microsoft, Yahoo, Google, Facebook, PalTalk, AOL, Skype, YouTube, and Apple.
- firstprimate 13y agoI provide a service to manage a personal mail server. See http://appxecute.com http://appxecute.com for more details.