15 ms·
The Death of External Storage: Where's Google?
- wodenokoto 8y agoThis might be obvious to android devs, but as an outsider, I am not sure if external storage here means SD+cards or just access to file system.
- CompelTechnic 8y agoI would like to know this as well.
- mirimir 8y agoRight. So is there now no user access to the device's file system? At all, I mean. And what about SD cards? And use of Dropbox or whatever? Or AWS and Google storage?
- Arnt 8y agoThere is user access, but app access is becoming scarce. An app can ask you, as user, to pick a file for reading/writing/creation, and it receives access to something very much like a file, but the app isn't even permitted to know whether that's a file on the local device or an on-demand download/upload by another app.
- mirimir 8y agoThanks. So is this to help protect apps from each other? And/or to protect users from malicious apps? And what if you've rooted the device, and installed your own file-management app. Could that app manage files normally?
- koolba 8y ago> So is this to help protect apps from each other? And/or to protect users from malicious apps? One angle is it prevents apps from scanning your local storage for files and stealing them. Another angle is that it blurs the line between cloud and local so that storing data on cloud services gets treated the same as local data. If you happen to own said cloud storage services (cough Google cough) then that direction aligns with your corporate interests.
- i_cant_speel 8y agoNot being concerned about where a file comes from sounds like a convenience to developers. It's like a file repository. I don't know why that implies Google is scheming to further integrate their cloud services.
- TeMPOraL 8y agoIt's not a convenience to developers, it's extra complexity. It's convenient for companies though, because it makes implementing cloud-centric business models easier. It's a problem for users, because they no longer have clue where the data is stored or how to find it beyond the app that claims to own it.
- Arnt 8y agoProtecting users from malicious apps seems to be the main thing. I think you can manage files even without rooting. I plugged a phone (XZ1C, Android 9) into USB now, the computer offered to open the phone's storage, 2-3 clicks later and I see the photos that are stored on the phone.
- Pxtl 8y agoWell considering that Android doesn't include a respectable file-browser built-in and so you have to do that through apps, that functionally means user access too. No, you can't see your file system. Not yours.
- Arnt 8y agoNot meaning to voice disagreement or anything, but do you have an example of a decent file browser?
- pbhjpbhj 8y agoNot OP but I like ES File Explorer. It perhaps follows a desktop FM form to closely, but works for me when I need to navigate the Android file system. Edit: There's a load of suggestions downthread, I think I might be on an older version of ES, maybe pihole is blocking some of the ads others are complaining of.
- fivefive55 8y agoEs was the best for awhile, but it's bloated and has ads now. I switched to Solid Explorer and it works great for me, nice UI and pretty quick. No complaints so far.
- Pxtl 8y agoThe Asus ZenUI one is pretty good, I use that.
- Yetanfou 8y agoAmaze File Manager does quite well, is free software [1] and can be installed from both F-Droid as well as the Play Store. [1] https://github.com/TeamAmaze/AmazeFileManager https://github.com/TeamAmaze/AmazeFileManager
- simias 8y agoThat seems pretty reasonable to me honestly given the whole mindset behind Android. Why would the average user even care about exploring the filesystem? And if you're a poweruser who really wants to have low level access then you can just root your device and run whatever you want on it. Regardless of whether you think it's good or bad design, at least it's consistent IMO.
- MayeulC 8y agoThis sounds very much like the model Google uses in its Fuschia operating system, where there is no access to the filesystem per se, but handles are passed around, that allow writing in a folder or a file, with various permissions attached to that handle.
- josteink 8y ago> There is user access, but app access is becoming scarce. But without an app to access it, how will the user get to the files?
- iggldiggl 8y ago> and it receives access to something very much like a file, but the app isn't even permitted to know whether that's a file on the local device or an on-demand download/upload by another app ... and which is also completely unsuitable for content that implicitly depends on multiple files, e.g. locally stored HTML files: For the case where an app is launched because you wanted to view a particular file, you'll only get access to that "something very much like a file" for that exact file only, but you (respectively your browser) cannot access any other associated files that might be required (images, style sheets, scripts and whatnot) that way, and neither would navigation among separate files stored locally work.
- gnomewascool 8y agoAccess to the general file system, outside the app-specific folders (Android/data/your.application.id/ if I remember correctly).
- jayd16 8y agoThat is part of the problem with this API its a pretty confusing choice. It technically means you give access to the entire SD card if you have it set to external card mode. However, there is a setting to use SDCards as a partition extension and it appears as extra 'internal' storage space. You could never access other app's internal files with this api. IMO this is a good change. This pattern only made sense when smart phones were simply nice camera phones with email.
- whatshisface 8y agoWhat is the rationale behind abandoning the filesystem? Filesystems have served well on multiuser systems for decades but for some reason have fallen into disfavor.
- deleted 8y ago[deleted]
- agildehaus 8y agoMost users can't handle hierarchy.
- crazygringo 8y agoPlease don't repeat this myth. It's simply not true. Every normal user can understand hierarchy -- shoeboxes in closets in rooms in houses in neighborhoods in cities. The human mind orders things in hierarchies effortlessly. It's just incorrect to claim otherwise. The only thing users sometimes can't understand are badly designed user interfaces for exposing and navigating a hierarchy.
- magduf 8y agoHumans might be able to understand hierarchy, and even apply it to physical objects in their possession sometimes, but looking at the filesystem of the average computer user would eliminate any notions you have that average users can actually maintain their own filesystems, or have any desire to.
- PascLeRasc 8y agoThat's a sign that we need to fix file hierarchy then, not that users are wrong or stupid.
- slig 8y agoThey just don't care. Whatever they have now is fine for them. How are we going to fix that?
- ape4 8y agoSo apps can't share files with other apps? eg take photo with app1, edit photo in app2, post with app3.
- ProblemFactory 8y agoThey still can, but app1 must use the Intents system to pass an access token to app2 to read its file(s).
- LifeLiverTransp 8y agoSo summed up- there will soon be a app called file-system, which provides the expected behaviour through the Object-Orientated Cruft to every app needing it?
- Spivak 8y agoThat's the intents system. You just declare that you want a file. A picker then opens up with every app that has files available, the user selects one, and you get a handle to it.
- LifeLiverTransp 8y agoSounds like a abstracted away filesystem to me.
- m-p-3 8y agoWith all the drawbacks and none of the benefits.
- Spivak 8y agoSeems uncharitable. * Apps are only allowed to access only files that the user explicitly allows them access to. (No more Epic games launcher slurping up your Steam library information) * Apps can present file-like objects to the file picker and have them work transparently. (No more one-off filesystems to just forward an API call) * Apps don't have to know anything about permissions. You just get a blob of data.
- tambourine_man 8y agoSo, to summarize, on par with iOS design’s decision from day one, right?
- ez7r6i 8y agoI've always hated that apps were allowed to do whatever the hell they wanted on Android. I'm happy to see these changes, as Android is cheaper than iOS, and now I've got two options instead of one.
- postalrat 8y agoI'm with you. It should have been this way from day one.
- ubercow13 8y agoThis seems like it's only an issue if you install apps you don't trust. It seems to me that the premise that you would want to install apps you don't trust is itself broken. Why should we give up the power and utility of our devices just to make this safe?
- dTal 8y agoIf it even can be made safe at all. I would have thought that Meltdown/Spectre would have made it very apparent by now that trying to perfectly isolate two programs on the same machine is like trying to make a colander float.
- jsight 8y agoWell, its a matter of degrees. I might want an app that I trust to have access to photos, but not my whole SD Card. That hasn't really been possible in the past. And we've seen that apps that are trustworthy can be bought and sold, sometimes by companies that are very untrustworthy.
- ubercow13 8y agoWhile trying to achieve that control, does this change really allow your most trusted apps to keep the same level of utility? It doesn't sound like it, for example it sounds like Termux will no longer be as useful
- realusername 8y agoAndroid is becoming more and more useless every year, we could have a powerful computer in our pocket to do everything we want and instead we have a dumb device with a clunky system which is just good for running chat apps and small games.
- Waterluvian 8y agoI want the Nintendo Switch of phones. I want to seamlessly walk off with it or put it into a dock and Bam, full desktop OS. But a good one. Not the janky answers that usually get posted in reply.
- Ajedi32 8y agoThere are some indications that they might be working a feature like that: https://www.xda-developers.com/android-q-dark-theme-desktop-mode-permission-revamp/ https://www.xda-developers.com/android-q-dark-theme-desktop-...
- Datenstrom 8y agoI would probably buy a Nintendo phone if they made one. Maybe they should get into the phone business.
- sithadmin 8y agoSamsung's DeX experience is pretty much there. At this point it's apps failing to account for user experience in desktop mode that 's holding it back from a usability perspective. Hopefully that'll change when Q Desk Mode is widely available.
- Folcon 8y agoI've been wanting this forever :)... I personally think there's demand for this, unfortunately I don't have the right background to prototype it.
- realusername 8y agoThat's exactly what I want as well, phones are powerful enough to do that. I could even use the phone screen as a second screen terminal and type with my keyboard in both, switching with ctrl+something. Everything is technically complicated on Android, I've also worked into customizing ROMs, trust me, Android kernel & top layer are so clunky that it's even a miracle that the phone is switching on. There's really nothing we can save from this garbage system. Sorry for the Android fans reading this but that's truly my personal opinion after digging into it for a few months. it's just piles and piles of hacks as far as the eye can see.
- aclelland 8y agoSo does this mean the end of apps like ES File Explorer?[1] I use that app all the time to manage downloaded files and to transfer local files to my NAS / S3 buckets it'd be a very sad day when that sort of functionality becomes impossible. [1]https://play.google.com/store/apps/details?id=com.estrongs.android.pop&hl=en_GB https://play.google.com/store/apps/details?id=com.estrongs.a...
- pengstrom 8y agoRegarding ES File Explorer: I used it heavily years ago, but with every new version I felt it became scrummier and sleazier and was not comfortable to continue, even with its impressive features. Is the paid version much better?
- ljcn 8y agoGhost Commander and Total Commander are good alternatives. The former is on F-Droid.
- sorenjan 8y agoI also used ES before it was sold, and I've heard nothing but bad things about it since. I find Solid Explorer to be a much better option now. Mixplorer is good too, and free. Cx File Explorer looks good too, but I haven't tried it.
- aclelland 8y agoYeah, I had almost stopped using the free version because of the user-hostile UX they kept pushing but they had a sale a few years ago and I picked it up then. It's like a completely different app, all the cruft like ads and pushing other apps is completely gone. You're just left with all the good stuff and those features generally all work well.
- bloopernova 8y agoI recommend X-Plore https://play.google.com/store/apps/details?id=com.lonelycatgames.Xplore https://play.google.com/store/apps/details?id=com.lonelycatg... (I am not affiliated with the creator) I like its column-based view of the filesystem, and the wifi server that you can open a web browser to and upload files from your laptop/desktop. Some of the features are paid, but frankly $5 for an app really doesn't bother me much as I try to donate at least that to the different open source projects I use a lot.
- teekert 8y agoI'm very happy with Nextcloud, otherwise I'd have no idea how to get my photos but for Google Photo's which I don't want to use.
- Causality1 8y agoIf I wanted to use iOS I'd buy a damned iPhone. I spend a large fraction of my time in a file manager, moving files back and forth from network storage and to flash drives. How the hell am I supposed to to tell when an app is shitting the bed by, for example, keeping a 20GB folder of thumbnail images?
- MrMember 8y agoMaybe I'm missing something but this sounds like a disaster. Is this the end of locally stored music libraries? Epub readers? Anything that relies on access to shared storage? If so I'm done with Android.
- dimensi0nal 8y agoDoes Google really think they can make a better iOS than Apple?
- ubercow13 8y agoThe filesystem was the number one reason I moved from iOS. Shame. I am not sure what to replace my current phone with now.
- devit 8y agoFinally. It's ridiculous that a supposedly sandboxed text editor would have access to all your photos, for instance. Apps should only have access to their own private storage and to data that the user has explicitly picked from a file picker or similar UI, which is what this update does AFAICT. It seems a serious mistake though to not affect apps installed on upgrade and to disallow access instead of just providing a virtual private copy of the external storage for each app (though the latter is not clear from the article).
- pmontra 8y agoI use syncthing to sync files from several folders of my phone (internal app storage) to folders on my laptop (usually as a backup) and viceversa (usually because it's easier to download some files on my laptop, think about GPX tracks). This means that I need synchthing to access all those folders. I also use an open source file manager app to access files on both internal and external storage. I need it to access all of it. I understand I'm not the typical Google user as I'm logged in only in Google Play and Google Drive, which I use for work and not for backing up stuff. However if they turn Android into iOS maybe I could finally buy an iPhone SE when the last small factor Android phone dies. Not really, because that would leave me with a much more closed down environment. Alternatives? Maybe a Linux phone if there will be something around, but I'll have to keep using an Android anyway, so going around with two phones, which is worse. What Google should do is give an option to lift all walls between applications (or root the phone). Void warranty and the likes, it's fine for me. I'm replacing all closed source apps from untrusted parties with open source ones anyway.
- semi-extrinsic 8y ago> This means that I need synchthing to access all those folders. FWIW Google Photos does exactly this. It even scans your directories and pops up a prompt "Hey, I found a new folder with images, want me to back it up?". I really wonder how this will turn out...
- massivecali 8y ago
- jcfrei 8y agoAre file managers still going to work in Android Q? If not, this is a huge step back in functionality.
- deleted 8y ago[deleted]
- Pxtl 8y agoSo does this mean that file-manager apps will no longer be usable? Because that's a serious DO NOT WANT. I need access to my filesystem on my device. Doing stuff like this is a promise that their less-power-user-y tools will do everything seamlessly, a promise they have repeatedly failed to deliver on. Getting Google Music to play nice with a my SD card was a nightmare until I gave up and just copied files over the network onto it directly and told it "search this folder".
- yoodenvranx 8y ago> So does this mean that file-manager apps will no longer be usable? I really hope that KDE Connect will be compatible with the new system. I use it almost every day to access files on my phone from my PCs.
- izacus 8y agoFile manager apps (those which cared) can still receive access via SAF API. They actually had to do that to expose all possible storages on Android - including OTG mounted drives. Apps that didn't do that will be broken now, but they weren't doing the right thing either way.
- Aissen 8y agoThere's a dead link in the first article of the series, pointing to the description of "roles": https://developer.android.com/preview/features/roles https://developer.android.com/preview/features/roles Is it a sign that isn't set in stone yet that it might be pushed ?
- Aissen 8y agoReplying to myself: the "roles" seem to exist as the "default Photo Manager app" and "default Music app", as documented here: https://developer.android.com/preview/privacy/scoped-storage#work-with-other-apps-files https://developer.android.com/preview/privacy/scoped-storage...
- bluecalm 8y agoWhy would anyone care which app created photos in a photo folder? I mean ask the user a permission for read/write access there, sure but once the photo is saved or should no longer which app created it. Same goes for other for types. Sometimes I want an to be able to access all files on my phone as well. The whole thing sounds like huge step backwards and frankly just bad design.
- prolepunk 8y agoI wonder what would happen with the apps like KDE Connect? I use the app to download photos, backup my phone, and generally avoid connecting to google shenanigans.
- m-p-3 8y agoI'm worried about Syncthing :(
- greenhatman 8y agoThere should be a Linux phone for technically savvy people who want a real computer in their pockets. Most of us are probably willing to pay a premium for this. Librem 5 Looks promising, but its hardware is not as good as the popular flagships. https://puri.sm/products/librem-5/ https://puri.sm/products/librem-5/
- badsectoracula 8y agoThis is outright bullshit, one of the most useful features of Android vs iOS is that you have a proper filesystem that all applications you trust have access to. I hope this isn't forced on everything and there is a flag somewhere in the settings that i can use to indicate which applications i trust that can have access to everything like before.
- m-p-3 8y agoAgreed, Librem cannot release their phone soon enough if file managers are crippled beyond repair.
- criddell 8y agoIt's a super-useful feature for a very small subset of users. Google has to balance making a phone that's useful to everybody and most of the people that buy an Android handset are more likely to be harmed by allowing apps access to the entire filesystem. People like you can root your device.
- arbie 8y ago> People like you can root your device. And lose access to Google Pay and WideVine DRM validation (Netflix)?
- toomuchtodo 8y agoThat’s the trade off, yes.
- syn0byte 8y agoExcept we can't in most cases; It's disallowed by vendors. The reason used to justify these arbitrary lockouts? Most users are "more likely to be harmed by allowing" it... Tautology much?
- izacus 8y agoAnd you can still grant that access explicitly - or grant access to a subtree. The only difference now is that apps won't get full, uncontrolled access to all your personal photos, documents and app data without your explicit consent and ability to limit them.
- EvagohP5 8y agoMen, lots of users will move to iphone
- apexalpha 8y agoThank you for this! Finally. I can only hope that Microsoft "every random binary has full systemwide r/w access" Windows will follow shortly!
- mbautin 8y agoWould this affect access to Android storage through the USB interface, e.g. through the Android File Transfer app ( https://www.android.com/filetransfer/ https://www.android.com/filetransfer/ ) at all? It is very convenient to just copy files from a laptop/desktop computer into the appropriate directories on Android, and then access them using apps.
- draw_down 8y agoLimiting apps' access to the file system is quite an interesting idea! I wonder if any of the other top 2 mobile operating systems do that.
- Aardwolf 8y agoWhat will this mean for the "Downloads" directory and PDF readers?
- bibyte 8y agoThis is just so sad. A proper filesystem is one of the distinctive feature of Android. If I wanted IOS like restrictions I would buy an iPhone.
- shittyadmin 8y agoI'm completely reliant on syncthing, termux, file browsers and such, it's literally why I prefer Android. I'm hoping most of these will be available for rooted users like myself still, but developers often lose motivation when most of their users evaporate.
- altfredd 8y agoThis is a very alarming move. Google's external storage ContentProvider is terrible: slow, buggy and lacks a number of basic features. It does not work as replacement of existing file managers, since it does not properly support searching and it's performance is abysmal, compared to using filesystem directly. AFAIK, there is still no proper support for selecting a file by extension: https://stackoverflow.com/questions/45573171 https://stackoverflow.com/questions/45573171 — if your file extension isn't in Android MIME database, this is it for you. The mime-filters for file extensions are completely broken: https://stackoverflow.com/a/31028507/1643723 https://stackoverflow.com/a/31028507/1643723. It is possible to work around that in file manager application (by using queryIntentActivities with different, modified Uri), but built-in Storage Access Framework file browser does no such thing. MediaStorage used to have tons of crippling bugs. Wrongly reported file sizes, delayed file addition, files, filled with zeroes... Some were fixed in preparation for Android Q release, but I doubt, that all of them did. MediaScanner is abhorrent by design. The options for flexible content generation are still bad. Prior to Android P you had to use pipes, which resulted in non-seekable files. ProxyFileDescriptorCallback remedied some issues of that approach, but it does not support FUSE interruption events — https://issuetracker.google.com/issues/38444582 https://issuetracker.google.com/issues/38444582: if you open a buggy FUSE descriptor, your app gets STUCK (and closing the opened descriptor from another thread won't not unblock you!) In effect, using files from other applications can now hang your app (it could before too, but only during ContentProvider#open() stage, now read() is broken too). The bug is trivial to fix, but there is still no fix 3 Android versions later. Google Drive is a great example, how NOT to mesh OS development and app developer interests. Google Drive does not properly implement Google's own DocumentProvider API — in effect, forcing third-party app developers to use it's proprietary web API. That's great for Google (vendor lock-in and all), but not exactly great for third-party apps, because the DocumentProvider API is effectively not cared about (see ProxyFileDescriptorCallback fiasco above). If one extrapolates this behavior to future Android development... imagine, that INTERNET permission is abolished, and you have to use Google's proprietary API for every single thing. Want to download a file? Use Google Downloads (tm) API in Google Services (the system DownloadsProvider will of course be broken as usual). Want to send analytics? Google Services! Crash reporting? Firebase. Communications? Cloud messaging. p2p file exchange? Too bad for you, — that kind of advanced functionality will likely require Chrome OS! The extrapolation above may sound overly pessimistic until you realize, that Android developers already made great many steps in that direction. Half of OS functionality is locked behind "system"-level APIs, that aren't accessible to ordinary apps, ever. But Google Services can of course continue to use them! As Mark said in his article, “the writing was on the wall”, although a lot of people (himself included) don't want to fully accept it.
- bitL 8y agoSuper schizophrenic. Since KitKat there has been back-and-forth movement wrt external storage. One of few advantages of Android phones was their extensibility by SD card (i.e. buying a basic model and adding a cheap 64/128GB card instead of paying extra $100-300 for the same in internal storage); if that won't be possible any longer, iPhone would sound much better to previous users. Limited extensibility - a way to turn most smartphones into landfill in 2 years... No "Green Deal" would be possible; moreover how far would security paranoia go? Would we need another processor that would verify main processor's operations and detect anomalies as well?
- izacus 8y agoThere seems to be a lot of misinformation and needless alarm in this topis. Let's clarify: - What's going away is the permission that gives an app full, uncontrolled access to everything in external storage, including data from other apps and your personal photos. - What IS NOT going away, is Storage Access Framework API (which was available from Android 4.4) which effectively gives you a File/Directory open dialog - same as on sandboxed macOS or Windows app. Using that dialog also grants application access to the selected document or directory tree to do what they will. This solution allows you, as a user, to explicitly grant an app a full access to a filetree without being forced to give it access to EVERYTHING on the phone. There are also now special roles for apps which come with some of these permissions granted. For example, an app with GALLERY role will still be able to access photos on device, but you as a user will have to choose a gallery.
- gnomewascool 8y agoJust to make sure, as there is conflicting information in various (more or less) trustworthy places, will apps using SAF have full rw random-access to files (contained in the tree to which they were granted access), without additional latency, and will the interface be available without Java (e.g. if you're using C/C++/Go etc.)?
- pjmlp 8y agoNo, they are Java only. Even the permissions are Java only. They worked around it on the NDK samples by removing the features that would require the use of the permissions API, just to show how seriously they take the NDK.