15 ms·
Download a copy of your Gmail and Google Calendar data
- umami 13y agoWhich would be the alternatives that allow to import an MBOX archive? I am not familiar with email storage.
- dangrossman 13y agoProbably most desktop clients. You can import an MBOX file to Thunderbird with the ImportExportTools extension (which Mozilla links from their KB): https://addons.mozilla.org/en-US/thunderbird/addon/importexporttools/ https://addons.mozilla.org/en-US/thunderbird/addon/importexp...
- nandhp 13y agoMany desktop mail clients support mbox format. Thunderbird uses mbox. There's also a script (I'm sure there are many scripts that do this) that take mbox files and upload the mail to an IMAP server. (http://imap-upload.sourceforge.net/ http://imap-upload.sourceforge.net/)
- sksk 13y agoMac Mail.app can import mbox files but the default storage is emlx if I remember correctly for Spotlight indexing. Thunderbird should also import mbox I am a bit paranoid about my Gmail account so I use the Mail.app to download the emails and then I back it up. If my account gets locked for whatever reason, 'Download Data' option is not going to exist. So better to backup through other means as well.
- ajross 13y agoVirtually everything supports MBOX (which, modulo a few gotchas, is just a concatenated file of the text-formatted RFC822 messages as they went over the wire). Most mail clients support it. Many mail servers do to, so for example you could drop this into /var/spool/mail on a AWS instance, run a default dovecot install, and hit the server with any IMAP client.
- old-gregg 13y agombox is a standard email storage format. It's not ideal for a live email system, but not bad for archiving or for import/export purposes. You can import mbox into variety of desktop email clients and, using IMAP, upload them to web-based UIs. Here's how to move off Gmail to Rackspace (not free) email, I've done it last weekend [1]: - Enable IMAP access in Gmail - Add Gmail account to Apple's Mail.app - Wait for Mail app to sync. - You have a full copy of GMail archive on your computer now - Select all messages in Mail app, and select Message/Copy To - Pick Rackspace inbox and click "OK" - Delete all your email messages in Gmail, purge Trash. - Done. I also exported Gmail labels into separate mbox files just in case. [1] http://www.rackspace.com/email-hosting/webmail http://www.rackspace.com/email-hosting/webmail P.S. For anyone wondering, I moved off Gmail because of two reasons: 1. New compose window was impossible for me to use. 2. Security issues.
- Groxx 13y agoI've done similar things a variety of times, the download -> copy -> paste routine is pretty simple. So far I've never had a problem with it (even moving 100k or so).
- corywright 13y agoMaildir please.
- Robin_Message 13y agohttp://wiki2.dovecot.org/Migration/MailFormat http://wiki2.dovecot.org/Migration/MailFormat might help
- deleted 13y ago[deleted]
- ISL 13y agoThank you, Google. Glad to hear that the Data Liberation Front is alive and well: http://www.dataliberation.org/ http://www.dataliberation.org/ From 2006: "We would never trap user data," he [Schmidt] said. [1] http://www.zdnet.com/blog/btl/google-ceo-eric-schmidt-we-would-never-trap-user-data/3902 http://www.zdnet.com/blog/btl/google-ceo-eric-schmidt-we-wou...
- lukasm 13y agoI have ambivalent feelings about this. All in all, this is my stuff.
- jmathai 13y agoAgreed but it takes time, effort and money to make sure that you can take your stuff with you.
- nandhp 13y agoI wonder if it does a better job of handling message duplication than Gmaill IMAP does.
- josephscott 13y agoThis is great news. Unfortunately downloading my Gmail content isn't listed as an option. I hope this isn't another case of Google App accounts not getting new features.
- bwillard 13y agoWe are rolling this feature out slowly, right now only about 1% of people have access to Takeout's of GMail. But we hope to increase it to 100%, including Google Apps accounts (if your administrator hasn't blocked it) over the next couple weeks.
- dmd 13y agoI'm wondering how mbox format is going to work for 20+ gigabytes of email. Am I seriously going to be presented with a multi-gigabyte-sized text file?
- generalpf 13y agoI bet they give it to you compressed, which should have a pretty good ratio unless your mail is a bunch of binary attachments!
- timdorr 13y agoFrom the article (last line): > The ability to download your Gmail messages will be rolled out over the next month.
- look_lookatme 13y agoDoes anyone know of the best way to migrate an mbox file into an existing imap account?
- old-gregg 13y agoScroll down to see a detailed how-to. I've used Apple's mail app to transfer messages.
- look_lookatme 13y agoAh excellent. Thanks.
- benjiprod 13y agoThank you mister !
- IvyMike 13y ago¡From hell's heart I stab at thee, lines beginning with the word "From".
- nanidin 13y agoUnfortunately this requires you to be able to log in. I had an account (with the same name I use here) mysteriously stop being able to log in about 6 years ago. I lost all of my email, contacts, and calendars. I was never able to find out why the account was shut down, I'm guessing it was a ToS violation for something I did several months before I got banned (made 100+ gmail accounts with my invites, didn't use them for nefarious purposes though.) Just one day I couldn't log in and got an ambiguous page about account deactivation. No amount of emails or form filling ever earned a response from Google. That was it. Blam. Gone. Ever since then, I have not trusted Google with any data that I care about. It would be nice if this tool worked for deactivated accounts.
- toomuchtodo 13y agoWait, so you weren't backing up your email account?
- drivers99 13y agoWait, how many people back up their gmail account?
- toomuchtodo 13y agoraises hand http://gmvault.org/ http://gmvault.org/ How does anyone get upset when something they're not paying for stops working?
- pfarrell 13y agoYou definitely pay for gmail. Paraphrasing Heinlein, you pay for it other than with money.
- toomuchtodo 13y agoI'm okay with that. It hasn't cost me anything I valued.
- kmfrk 13y agoI can't find a download button for my YouTube archive for some reason. Looking forward to moving it to Pinboard, though.
- tehwebguy 13y agoMBOX, cool! I wonder if you could do this to speed up the full download of your Gmail inbox into Mail.app (etc) rather than letting Mail download each message, one at a time. It will be interesting to see how many people that have been demanding this for years actually make the leap!
- kmfrk 13y agoIf any of the Google people are in here, I would consider adding a feature that delays access to your new archive by 48 hours. As great as export features are, I imagine it's the thing hackers who compromise an account will go straight for.
- robryk 13y agoThere is always IMAP access. I had no trouble downloading everything via IMAP every time I wanted a copy on a new machine (and a random person on the internet would expect no significant trouble when setting up a new mail client, so making this difficult seems impossible).
- vijucat 13y agoHere is the simplest solution I found to taking a backup of your gmail. The only glitch is that the mirror account will of course be a perfect image only if you set up the forwarding from day one :-( I had to use gmvault (gmvault.org/) to make a copy of my gmail; it was quite doable. Pasted from http://www.webmonkey.com/2008/11/simple_solutions_to_help_you_avoid_the_google_fail_whale/ http://www.webmonkey.com/2008/11/simple_solutions_to_help_yo... "Create some backup accounts — This one is so obvious I’m always surprised to hear that not everyone does it. Gmail is free and lets you have an unlimited number accounts… so open a second one. Mine is just my usual account with .bak appended to the username. Once that’s set up, login to your primary account and either enable forwarding for all messages (Settings >> Forwarding and POP/IMAP) or create filters to only forward the messages you really care about. Then just send those messages on to the backup account. I use my main Gmail account to manage five e-mail addresses, so I used the filters method and only back up a couple of them (the others are already backed up on the original domain’s mail server). I also have the forwarding set up to pass messages along to a Yahoo Mail account, an account on my own server and even a good old Hotmail account (or Windows Live Mail as it’s known these days). This setup is like a good investment portfolio, think of it as e-mail diversification — your’re hedging your bets by spreading your mail around to several servers. If something goes wrong on one account, just login to another. I don’t login to the other accounts much, so they aren’t as carefully filtered, organized and de-spammed as my main Gmail account, but at least my mail is there"
- gky2 13y agoThanks for sharing. In the case of GMVault, how "important" do you think your email needs to be for you to use something like that, as opposed to using Google's solution when it comes out? Or asked in a different way, what do you feel GMVault could offer which regularly archiving emails using the Google solution can't?
- jcastro 13y agoYou can automate gmvault to snag everything and then just do daily/weekly syncs instead of manually having to remember to go to a website every once in a while and download everything each time.
- makmanalp 13y agoHmm, first thing I thought was, there goes Backupify's business model: https://www.backupify.com/ https://www.backupify.com/ Also, holy crap, it's great to see MBOX going strong after 20 odd years.
- bradbatt 13y agoNot really imo…they are an automated, set-it-and-forget-it backup service. Not quite the same thing for me to have to remember to go in occasionally and download a full copy of my data versus having a service do it for me once or multiple times a day. Especially for businesses who want to manage multiple accounts and have a centralized backup system.
- baudehlo 13y agoPlus the critical thing here: Backupify has restore. Who wants backup without restore?
- akennberg 13y agoYou don't need to restore with Gmail.
- baudehlo 13y agoOne "restore" preference people have is account migration. Take all your email from one gmail account and import it into another. Plus your response makes my mind boggle. People consider their gmail way too solid. There's lots of posts online of people who have lost their accounts completely.
- agwa 13y agoMbox, eh? Can anyone confirm that they've implemented this properly, particularly when it comes to escaping lines in message bodies that start with "From "? Failure to properly escape such lines was an infamous bug with Mail.app's mbox exporter[1]. [1] http://web.archive.org/web/20070329131522/http://diveintomark.org/archives/2006/07/13/mail-checks-in http://web.archive.org/web/20070329131522/http://diveintomar...
- abrahamsen 13y agombox can't be implemented properly, it is an inherently broken format. Or rather, a family of almost compatible broken formats. https://en.wikipedia.org/wiki/Mbox https://en.wikipedia.org/wiki/Mbox Sounds like Mail.app exported in mboxcl2, which breaks mail readers expecting the mboxo or the mboxrd formats. I recommend people to use IMAP for extracting the mail, and to store it in something outside the mbox family.
- gamache 13y agoI've got mbsync set up to periodically dump my Gmail into a local Maildir archive. Works great, and it was a (relative) breeze to integrate with my old mail archives reaching back to the late 90's.
- groby_b 13y agoHow is mbox a broken format? It's a bad idea to use it in a multi-writer environment, and it's horrible because there are competing versions of it. But for plain storage, I thought it worked quite well. What am I missing?
- chalst 13y agoAny line following a blank line and beginning with the four characters "From" marks the start of a new message. The BSD way of handling such lines in the body of a message was to prefix them with ">", which is a non-reversible workaround and is in the uuencode target charset. Prefixing every line in the message body with a tab character would allow reversing and not interfere with uuencode/base64&c.
- brucehart 13y agoFor anyone looking to an alternative method, there is a great open source Python script called Bagoma that incrementally backs up your Gmail account: http://bagoma.sourceforge.net/ http://bagoma.sourceforge.net/ . Each email is stored as an individual text file rather than the mbox format. I have backed up my account with it every few days for a couple of years and it works great. It will even restore your account to Gmail if you need to switch accounts or accidentally delete messages.
- js2 13y agoA similar project is http://gmvault.org/ http://gmvault.org/ I'd never heard of bagoma before. I've used Gmvault successfully on both gmail and google apps accounts.
- bentcorner 13y agoI've never heard of either and just tried out gmvault and it's currently running and appears to be working. Anybody tried out both and have data to share?
- ep103 13y agoFWIW I needed to do this to back up business emails when I closed down my last shop. At the time, all the open source projects I found didn't manage to correctly download ALL messages. I was finally able to do it by doing an HTML inject, and using JS to load each email iteratively.
- znowi 13y agoOK, my archive is being collected as of now. It was so easy, with a direct link to the takeout, with Gmail preselected, and a one click operation - I almost wonder what the catch is :) I suspect it might have been a bit of a battle to push this through the top management. Anyhow, whoever did this - thank you.
- Matt_Cutts 13y agoGmail has supported POP and IMAP for years, and it's been possible to back up your email using that, e.g. http://www.mattcutts.com/blog/backup-gmail-in-linux-with-getmail/ http://www.mattcutts.com/blog/backup-gmail-in-linux-with-get... but I'm really glad that it's much easier now.
- Zoomla 13y agoreally easy but not incremental?
- nodata 13y agoIMAP is incremental.
- mrcactu5 13y agoNow I can do text analytics. I wonder who I write most often to at night?
- etucexe 13y agoAnyone else not seeing Gmail as an option for archiving?
- packetslave 13y agoSee the reply from bwillard above: it has only been rolled out to 1% of accounts and will be ramped up to 100% over the next few weeks (assuming all goes well)
- wodenokoto 13y agohasn't this always been possible with a desktop email client?
- menacestudio 13y agoIs it just me or does anyone else think that Google is possibly thinking of dropping Gmail service as well? Think Google Reader.
- drcode 13y agoNot impossible, though I'm guessing gmail is used widely enough that it would be a PR nightmare if they did this, much worse that the greader fiasco. They're probably forced to keep gmail alive, whether they want to or not.
- packetslave 13y agoPretty sure nobody anywhere thinks that.
- Matt_Cutts 13y agoNope, I definitely don't think that.
- dannyr 13y agoGoogle allows you to download your files from Google Drive. Is Google dropping Drive as well? /sarcasm
- redbullcat 13y agoGmail is one of Google's core services...they couldn't just kill it off.
- ollyculverhouse 13y agoNot a chance. Gmail is way too valuable for Google to just shut down (and no Reader wasn't as valuable).
- Nux 13y agoNah, if they close down gmail they're going to lose a lot of people. They still have not brainwashed enough with G+. I do suspect though that gmail's pop3/imap will go the way of the xmpp.
- 13y ago
- hafichuk 13y agoIIRC, the last time Google gave a service the ability to download (export) data, they closed it shortly there after. (RIP Reader)
- humbledrone 13y agohttps://www.google.com/settings/takeout https://www.google.com/settings/takeout Exporting data via Google Takeout is supported for 15 (and counting) products, including Youtube, Google+, Drive, and more. Google made a commitment to make it easy to extract your data, and is executing on that. It has nothing to do with shutting services down.
- jefferph 13y agoI recently migrated away from gmail and before I left took a back of "All mail" up using mbsync ( http://isync.sourceforge.net/mbsync.html http://isync.sourceforge.net/mbsync.html) which was easy to setup and quick to run. As a bonus this gives you your mail in Maildir rather than mbox.
- Aldo_MX 13y ago> The ability to download your Gmail messages will be rolled out over the next month while Calendar data is available to download for everyone today. Oh...
- rooster8 13y agoAny Mac OS X users here using Horcrux? https://itunes.apple.com/us/app/horcrux/id557880555 https://itunes.apple.com/us/app/horcrux/id557880555 It's written by a HN guy. I've had it on my wish list for a while, but I haven't pulled the trigger yet. Can anyone give an opinion on it?
- marquis 13y agoI download my Gmail regularly via Thunderbird so I have a local backup. Horcrux looks useful - will try it once they have Mavericks support.
- davidgerard 13y agoAt sodding last. Previously they only allowed IMAP interface, but their IMAP was fucked-up and broken. Most of the development work on offlineimap was compensating for Google's blithe disregard for piffling details like the RFC.
- wildfire 13y agoI think you mean, they've spent years compensating for assuming that everyone would implement the RFCs similarly. I'm not aware of RFC breakage, do you have any pointers?
- sixseven 13y agoAm I the only one who can't see the Mail backup option? Only the Calendar option is available for me.
- alecsmart1 13y agoThey will be slowly rolling it out over this month.
- Zoomla 13y agoclick "Create an archive" and you will then be able to select other Google services
- mmorey 13y agoYou can also use getmail[1] to backup Gmail. If you are not happy with Mbox you can specify multiple formats including Mbox and Maildir[2]. [1] http://pyropus.ca/software/getmail/ http://pyropus.ca/software/getmail/ [2] https://gist.github.com/mmorey/7810612#file-getmail-gmail-configuration https://gist.github.com/mmorey/7810612#file-getmail-gmail-co...
- tezzer 13y agoI've been using Thunderbird (IMAP) to keep a local copy of my gmail for ages. It works very well, and as a bonus, you can sort by field and get more than 20 responses per page to a search.
- rnnr 13y agoStill Google doesn't let you download your search queries log and clicked results.
- nodata 13y agoSave to Google Drive please.
- anoncow 13y agoAppreciation and respect.
- jnoland 13y agoThis is Google's way of saying, "Happy Holidays..."
- unicornporn 13y agoOK, so let's say I export all emails from Gmail from 2004 til today and I want to import them into Outlook.com. How would I go about doing this?
- sdrinf 13y agoImap. Simplest solution might be: * download & open up thunderbird * Add 2 accounts: your existing gmail account, and your new outlook.com account * select all email in the inbox of your gmail account, ctrl+c [this will take a while] * open the inbox (or other folder) of the outlook account, ctrl+v Personally, the largest migration I've done using this method was ~1GB, but should work for larger accounts as well. Hope this helps!
- yanokwa 13y agoThe problem I have with this download a copy approach is that it's not a great backup (not automatic, not easy to find individual things to restore, etc). For that, I use CloudPull from http://goldenhillsoftware.com http://goldenhillsoftware.com and it's by far the best Google backup tool I've found. I've tried gmvault, fetchmail, offlineimap, and pretty much every thing in between. CloudPull supports Gmail, Google Contacts, Google Calendar, and Google Drive/Docs. The app backs up Google accounts in the background and all the data is available in standard file formats. Anyway, I don't think enough people know about it. If you want a useful automatic backup of your Google life, give it a whirl. It's one of my favorite pieces of software.
- eximius 13y agoAs of now (12/6 - 2:33 CST), it appears GMail archives have been removed?
- bandage4ndr3vv 13y agogetting the same issue here
- jlgaddis 13y agoI moved all three of my Google Mail accounts to my own mail server several months ago. I used "imapsync" to get my mail from Gmail to that server.
- zx2c4 13y agoWill label data be included somehow with the mbox file? What about read/unread status? This metadata is essential for any real data liberation.
- FeloniousHam 13y agoScroogled again.
- potench 13y ago"Got Your Back" https://code.google.com/p/got-your-back/ https://code.google.com/p/got-your-back/ is a pretty awesome python script that downloads/backs-up all your gmail to your hard drive. I've used it to backup 6 years of work email before leaving the job - then created a new gmail account and used GYB to push all those emails back onto an archive account (for easy indexing just in case I ever need to reference an old email).