9 ms·
RIP iCloud, Self-Hosting Part 5: Finale
- 1vuio0pswjnm7 6y agoAuthor is still using an iCloud email address. Need a Self-Hosting Part 6.
- gogopuppygogo 6y agoI stopped reading when he started talking about using a credit card instead of Apple Pay. Lost me on the benefits of not needing to charge his card and how nice it is to have the plastic in his hand. Not only would I rather have the protections Apple Pay offers but if you want to disconnect that badly just use cash. Heck, stop carrying a phone. Richard Stallman even talks about how cell phones are surveillance devices: https://stallman.org/rms-lifestyle.html https://stallman.org/rms-lifestyle.html He’s not wrong. Most people don’t know to care and many people who know don’t care. Welcome to 1984 in 2020.
- waste_monk 6y ago>Most people don’t know to care and many people who know don’t care I know, and I'd rather not have a phone at all (I used to use it extensively to read ebooks, but have since moved to a dedicated e-ink reader), but it's hard to participate in modern society without one. RMS is in the position to do so because he has various assistants and means of dealing with his personal quirks - people are aware of this and work around him. But RMS is a celebrity - if I refused to own a mobile phone and something went wrong at work while I was on-call and away from my house I'd be in deep trouble.
- codetrotter 6y agoI too limit the amount of iCloud integration I use a bit. After cancelling my iCloud 2TB plan, and turning iCloud off for photos I learned that being able to transfer photos off of my phone is not so easy. Because basically Apple wants you to use iCloud for your photos or to sync between your computer and your phone. But I take a lot of photos as well as long videos and heaps and heaps of screenshots from articles that I read. The internal SSD on my MacBook Air is only 128GB, so I had to resort to an external drive. With huge amounts of images and photos in a Photos library macOS keeps wanting to scan through all of them and it spends forever to do so. I began creating new Photos libraries but at that point Photos libraries begin to feel rather pointless. In order to find photos I’d have to sift through multiple libraries and each of them would want to scan the whole library again. Aside from that the big annoyance with importing into Photos (instead of syncing) is that it does not transfer albums and favorites, it only transfers the media files. So I was manually selecting photos and organizing stuff but that takes time so I put off transferring photos and videos and screenshots from my phone for a couple of months. Very recently I finally found an application for macOS that uses the iPhone backup protocol in order to transfer whole albums and favorites. But it cost $60 so I was hesitant to buy it because I was very low on money so it was a significant amount. Instead I started doing a full backup of the device. About 30% through the process my phone goes in to a reboot loop. I speak with an Apple store, I speak with Apple and I speak with a data recovery specialist company. The data recovery specialist company told me that from the description I was giving them about what had happened, it was highly probable that data had been corrupted and that this would make it impossible to recover anything. They could have a look at it for a fee of $150 they said, and recovery if possible would cost between $400 and $1000. Naturally this was way above what I could afford. So I went through with factory reset on my own instead, which means accepting that the data was gone. I lost a couple of months worth of photos and videos and screenshots. Which sucks. At the same time though, nothing much exciting happened in these months anyway so it’s not a disaster either. But I would have preferred to not lose the data because there were a select few memories in there from that time that would have been nice to keep. I am also growing worried about my data in general, as the drives I use are starting to age. I can’t afford new drives at the moment but began looking at renting storage from Hetzner. Anyways, in terms of what’s on the phone I now have iCloud photos turned back on on the 5GB plan and try to transfer regularly using the macOS third-party application that I mentioned. After losing the data on my phone I shelled out those $60 for said application. It’s still a bit more cumbersome of a procedure compared to storing more in iCloud but at the same time I think this is pretty ok. This way, as long as I keep transferring to my computer when iCloud is full I always have the photos transferred or they are in iCloud. And then after I transfer them to the compute I delete them from the phone. Ironically as I am typing this I ran out of storage again earlier today, but I am going to transfer the photos and videos that are currently on my phone as soon as I get home. And if my phone should misbehave again, or I lose the phone or whatever, well at least this time it’s a few hours worth of data that I am losing and not a couple of months worth.
- xiwenc 6y agoThanks for the inspiration. I have similar problems now. Gonna use icloud as buffer and start moving out and sort photos to own NAS (synology in this case).
- jmathai 6y agoI moved my photos to Synology 5 years ago and have never looked back. I did some very thorough research into a number of options including iCloud, Dropbox, Google Drive, etc. and they all had some really odd behavior which kept me from using them (i.e. getting select photos into iCloud Photos was impossible - it was every photo taken or nothing ... and don't get me started on iCloud Drive's incompatibility with iCloud Photos). Right now I'm using DS File from Synology to transfer photos to my NAS and from there there's a script [1] that organizes it into a destination folder which is then synced to Dropbox and Google Photos simultaneously. So I get to use Google Photos as my primary photo viewer but it's just essentially a cached copy of my library (which I could trash and restore at any point). I have a series of blog posts [2] about my setup. [1] https://github.com/jmathai/elodie https://github.com/jmathai/elodie [2] https://medium.com/vantage/understanding-my-need-for-an-automated-photo-workflow-a2ff95b46f8f https://medium.com/vantage/understanding-my-need-for-an-auto...
- tchalla 6y agoYour Elodie script looks great! I have a question. Is it possible to use your script and bypass Google Photos completely? For example, would it be possible to directly put sync Photos from iPhone to NAS whenever you are within a WiFi network?
- jmathai 6y agoYes. The default configuration does not include Google Photos at all. The script doesn't make many assumptions so you can get it to do pretty much anything (i.e. I wrote a plugin to have it upload a copy of every photo to Google Photos). Here's an example of how you could get it to do what you asked if you were using Synology. 1. Use DS File's Photo Backup option to automatically sync photos from your phone to your Synology. 2. Have a scheduled task on your Synology to process photos in the synced folder to your destination folder. (I have this run every minute - it's cheap, I'm impatient, it's worked for years) 3. (optional) Configure Cloud Sync to sync the destination folder to Dropbox/Google Drive/etc. (Now you've got 2 geographically distributed copies of your archive and each supports versioning)
- shocks 6y agoApple Pay is a godsend right now. Contactless payments up to £1000 mean I can pay for basically everything without touching anything. IMO, pick your battles. I’m happy to pay £0.79 to backup all my photos, and £5/m for decent email. I’ve self hosted before. It’s too much stress for me.
- ValentineC 6y ago> IMO, pick your battles. I’m happy to pay £0.79 to backup all my photos, and £5/m for decent email. I agree. There's so much peace of mind in having my photos uploaded to the cloud every so often, and my phone automatically backed up every night. It's possible to go further: iCloud on Windows is able to automatically download the actual files, so those get backed up somewhere else.
- roydivision 6y agoYup, I’ve tried doing all this myself, interesting technical exercise, but realistically I have other things to do. Additionally to iCloud I have configured my Mac Mini to download all files and photos, which are then backed up using BackBlaze.
- ValentineC 6y ago> Additionally to iCloud I have configured my Mac Mini to download all files and photos, which are then backed up using BackBlaze. Do you just back up the `Photos Library.photoslibrary` folder?
- toomuchtodo 6y agoYes (not OP, but I do the same). If you're worried about something munging that data, you can take a point in time snapshot of that folder to B2 using the Backblaze UI, and it'll dump a zip of the folder into B2 for you.
- tinus_hn 6y agoWait until you experience the stress of Apple deleting all your photos including the backup, because someone got them to clear your account.
- deleted 6y ago[deleted]
- aborsy 6y agoYou could encrypt before uploading to iCloud. That may address some of your privacy concerns. I note though that not every type of data can be easily encrypted. Doing encryption correctly with proper key management can also take some effort.
- captn3m0 6y agoYou don't always have a choice, for eg - WhatsApp backups are unencrypted to iCloud. I don't think there is a way to get complete WA backups without using iCloud.
- tinus_hn 6y agoWhatsapp data is included in iPhone backups so if you create local backups of your phone you have them. These can be encrypted on the phone.
- aborsy 6y agoIf you stay in the walled garden! I was not successful to transfer WhatsApp’s chats from android to iOS. I ended up uploading unencrypted to google.
- iDemonix 6y agoThis article is garbage. > So yeah, try feeling grounded with that. It's a miracle that it even works. Just because something is too complicated for you to understand, doesn't mean it's no good. Is this guy going to decline machines/life support in hospital because he thinks he could build something simpler? I self host some things, mainly websites, but trying to self host the amount of stuff in that article is a fools errand. You'll spend more time updating, patching, and failing to notice any gaping security holes. I'm quite happy to pay Apple about 79 pence a month to deal with all that for me.
- fredsted 6y agoYeah, one could make a similar argument with self-hosting: How the data is transferred physically through undersea optical cables, how internet routing works and the complexity of it down to how the hardware underlying his Nextcloud installation works. It is really a miracle that it all works, though. I've been self-hosting my e-mail, and I'm thinking of switching to Google Apps, Fastmail or Protonmail due to the fact that sometimes my emails just go directly to spam. There's also the worry that my server might get hacked, and the maintenance that you often have to do. My time is orders of magnitude more than the few dollars a month all this costs.
- mosselman 6y agoThere are privacy conscious alternatives to the expensive providers such as proton. Mailbox.org is the one I went with, but there are others. Many provide inbox encryption through gpg. I could be very wrong, which I often am, but I believe that proton is also inbox encrypting like you would with gpg and their service is some sort of wrapper around that. The downside to proton for me was price and having to use their client. There is an “imap-bridge” that you can run, but that feels hacky and in the end if I really wanted all that I could also opt into using the aforementioned providers with gpg inbox encryption.
- bartvk 6y agoPlease don't call an article "garbage" just because something is too easy for you. It doesn't mean it's no good.
- captn3m0 6y agoInteresting, didn't know "iCloud Backup" could be self-hosted. I'm self-hosting everything else except for that one item on the list, I might as well make the jump.
- ValentineC 6y agoThe downside of self-hosting "iCloud Backup" is having to plug one's phone into one's computer every time they want to do a backup. There's probably a way to do a daily wifi sync using iTunes, but that doesn't seem to be documented anywhere. I personally like how iCloud automatically backs up my iPhone whenever it's charging and connected to wifi.
- lavios 6y agoItunes can also sync over Wifi[1] or You can use Nextcloud[2]. You can backup your photos to your PC/Mac and then upload them to a cloud service. I use duplicati[3], it automatically encrypts and compress your files and uploads them to the cloud service of your choosing. I use Backblaze B2 for the cloud service($0.005/GB)[4]. [1]https://support.apple.com/en-us/HT210612 https://support.apple.com/en-us/HT210612 [2]https://nextcloud.com/install/#instructions-server https://nextcloud.com/install/#instructions-server [3]https://github.com/duplicati/duplicati https://github.com/duplicati/duplicati [4]https://www.backblaze.com/b2/cloud-storage.html#why-b2-menu2 https://www.backblaze.com/b2/cloud-storage.html#why-b2-menu2
- sneak 6y agoPeriodic reminder: Most data in iCloud, including device backups (that includes full message history) and Photos, is not end to end encrypted and can be accessed by Apple without a warrant. They provide this data upon request automatically to the US military and federal government without a warrant.
- BigJ1211 6y agoDo you have a source for this?
- jiriro 6y agoI think sneak refers to the iCloud security overview: https://support.apple.com/en-us/HT202303 https://support.apple.com/en-us/HT202303
- LexGray 6y agohttps://support.apple.com/en-us/HT202303 https://support.apple.com/en-us/HT202303 Only the end to end section up is theoretically secure from disclosure to law enforcement. So Keychains, Health, Home, Maps, Safari history and tabs and Siri are secured. There is a note that messages in the cloud is secure, but that the key is stored in an insecure iCloud backup if enabled. Everything else... Email, Contacts, Bookmarks, Calendars, Files, Notes, Photos, Backups are fair game. Edit: however I’ve not heard reports of data being provided without a court involvement. https://www.apple.com/privacy/government-information-requests/ https://www.apple.com/privacy/government-information-request...
- sneak 6y agoApple participates in PRISM, revealed by Ed Snowden, which obtains data under the FISA Amendments Act (FAA) Section 702, which does not require a warrant. Instead, they set up a secret, unaccountable court (the FISA court) which rubber stamps these activities, almost without exception. This allows them to say the accesses are “court supervised” or other such weasel words. It does have “court involvement” - a secret, kangaroo court designed for the purpose of satisfying people who like the phrase “court order”. It’s not a warrant, scoped to a specific thing, issued only on probable cause. The widespread use of 702 for domestic warrantless spying, including PRISM, has been cited by Ed Snowden as one of the things that caused him to become a whistleblower. https://www.eff.org/702-spying https://www.eff.org/702-spying
- tuananh 6y agoi use icloud photo just for buffering between devices. my setup is like this - photos from my phone/my wife's phone backed up to NAS whenever we're home (geo-fencing). - those photos got backup to cloud - TODO: backup to my parent's NAS maybe
- lxgr 6y agoUsing Apple Pay vs. not using iCloud is a false dichotomy in my opinion. It's perfectly possible to disable all components of iCloud (most notably backup, but also email, contact sync etc.) and still stay logged in, which is the only thing required for Apple Pay to work. To be precise, almost any relevant components: Most notably, calling history seems to be synced across devices through iCloud by default and without any explicit option to disable it. The same applies to some minor (from a data privacy/autonomy point of view) features like syncing AirPods pairing across devices.
- ricktdotorg 6y agoan extremely good replacement for the iOS "Notes" app is Standard Notes. i cannot recommend this app enough. open source and yes you can host your own server. https://standardnotes.org/ https://standardnotes.org/