5 ms·

If any Google employee reads this, how do you check how much data is in a specific drive folder? I haven't found an official method. I need to free up space, t

by jerrac 6y ago

If any Google employee reads this, how do you check how much data is in a specific drive folder? I haven't found an official method. I need to free up space, thanks to the new storage policy. It's kinda hard to track down which directories are using the most data when there is no way to check...

IceWreck 6y ago
Rclone's size command does this. rclone size gdrive_remote:/path/to/folder
- rmorey 6y ago
  rclone also has the really nifty ncdu command: https://rclone.org/commands/rclone_ncdu/ https://rclone.org/commands/rclone_ncdu/
  - jerrac 6y ago
    Just tried that. It works. Thanks!
- jerrac 6y ago
  Nice. That worked well. Thanks!
CarelessExpert 6y ago
I'm not a Google employee, but as far as I'm aware, there isn't one, and frankly, at this point I have to wonder if the lack of such a feature is a malicious way of preventing users from managing their storage utilization. I've also had to resort to using rclone for this, which is absurd. P.S. And don't forget: the data in the Trash folder counts against your quota. So if you use rclone to get folder sizes and start deleting things, you better be sure to empty the trash. And that gets very difficult if the Trash has a lot of items in it, as the web interface will only delete a limited number of items from the Trash at a time. As a result, you might also want to use rclone to delete permanently and bypass the Trash entirely. Once again, while I tend to assume incompetence over malice for most things, in this case, you really gotta wonder...
- deepl_derber 6y ago
  Trash is now auto-emptied. You can also view objects by the quota they consume at https://drive.google.com/drive/u/0/quota https://drive.google.com/drive/u/0/quota
  - CarelessExpert 6y ago
    > Trash is now auto-emptied. After 30 days, IIRC. That's not helpful if you're trying to manage quota now, and certainly isn't an excuse for the truly astonishingly bad UX around the trash bin. > You can also view objects by the quota they consume at https://drive.google.com/drive/u/0/quota https://drive.google.com/drive/u/0/quota Objects as in individual files. It does not show you which folders are, in aggregate, consuming large amounts of storage. As a result this is utterly useless unless your quota is taken up by a few large objects. I legitimately have no idea what use case they thought they were addressing when they built that view.
    - deepl_derber 6y ago
      I think the UX around the trash bin is pretty good and I've always found the quota pane useful.
kyrra 6y ago
(Googler, opinions are my own). I also don't work on drive, these are my rough understanding of things. There may not be a way to do this yet, but hopefully should be coming someday. One key thing to understand is that Google Drive seems to be implemented as a graph, not a tree. This becomes apparent when you realized that any item (folder or file) could be placed into multiple directories on your drive. This allowed for cycles and lots of other crazy things within the filesystem (as you aren't guaranteed to have a single parent folder). Now, this behavior finally changed in Sept 2020[1], and they are backfilling all mutli-links to be shortcut (symlink) based. This should finally allow for proper directory navigation and determining size. It also fixes all kinds of other problems that a graph file system causes. [1] https://cloud.google.com/blog/products/g-suite/simplifying-google-drives-folder-structure-and-sharing-models https://cloud.google.com/blog/products/g-suite/simplifying-g...
- CarelessExpert 6y ago
  > This allowed for cycles and lots of other crazy things within the filesystem (as you aren't guaranteed to have a single parent folder). That doesn't prevent a folder size calculation. It does mean you need to do a graph traversal, and you might need to supplement the feature with a visualization akin to what you get from windirstat/baobab/etc, so users know what's factoring into the calculation. It also likely means this isn't an instantaneous operation, but again, I look at windirstat/baobab as examples for how to present a UX that's workable. But that doesn't prevent the feature from being built, and the fact that rclone already has it says to me the gdrive team has simply chosen not to make this functionality available.
  - kyrra 6y ago
    I agree that it doesn't prevent it. Traversing a graph is a simple compsci problem, but optimizing it is more complicated. My guess is that it prevent caching of folder sizes, so any size checks require full graph walks, which are not cheap.
    - kyrra 6y ago
jerrac 6y ago
Here are my thoughts on the issue. (To be clear, my thoughts have no input from my workplace.) A) Why wasn't proper usage reporting built in from the start? If you are limiting a user by a usage metric, then you should be giving them a way to manage that usage intelligently. It does sound like Drive is a complicated structure, but, well, that's no excuse for not supporting your users properly. B) I'm not surprised by Google ending the unlimited plan. But I still consider it bait and switch. Promising "unlimited" in the first place is impossible. It's false advertising. All the companies that do, or did, that, really should be fined. At very least we should hit them with a class action. C) Google's method of ending the unlimited plan is not very good. They really should have done something like: "We are ending the unlimited plan. New users will receive 100TB. Current users with more than 100TB of data will be granted a perpetual 120% of their current data usage as of last night at midnight UTC. Current users with less than 100TB, will have a 120TB limit." That would have been far more fair, and much less of a bait and switch. Anyway, thanks to everyone who replied. The tips about rclone really helped out.

by jerrac 6y ago

IceWreck 6y ago

Rclone's size command does this. rclone size gdrive_remote:/path/to/folder

rmorey 6y ago
rclone also has the really nifty ncdu command: https://rclone.org/commands/rclone_ncdu/ https://rclone.org/commands/rclone_ncdu/
- jerrac 6y ago
  Just tried that. It works. Thanks!
jerrac 6y ago
Nice. That worked well. Thanks!

CarelessExpert 6y ago

I'm not a Google employee, but as far as I'm aware, there isn't one, and frankly, at this point I have to wonder if the lack of such a feature is a malicious way of preventing users from managing their storage utilization. I've also had to resort to using rclone for this, which is absurd. P.S. And don't forget: the data in the Trash folder counts against your quota. So if you use rclone to get folder sizes and start deleting things, you better be sure to empty the trash. And that gets very difficult if the Trash has a lot of items in it, as the web interface will only delete a limited number of items from the Trash at a time. As a result, you might also want to use rclone to delete permanently and bypass the Trash entirely. Once again, while I tend to assume incompetence over malice for most things, in this case, you really gotta wonder...

deepl_derber 6y ago
Trash is now auto-emptied. You can also view objects by the quota they consume at https://drive.google.com/drive/u/0/quota https://drive.google.com/drive/u/0/quota
- CarelessExpert 6y ago
  > Trash is now auto-emptied. After 30 days, IIRC. That's not helpful if you're trying to manage quota now, and certainly isn't an excuse for the truly astonishingly bad UX around the trash bin. > You can also view objects by the quota they consume at https://drive.google.com/drive/u/0/quota https://drive.google.com/drive/u/0/quota Objects as in individual files. It does not show you which folders are, in aggregate, consuming large amounts of storage. As a result this is utterly useless unless your quota is taken up by a few large objects. I legitimately have no idea what use case they thought they were addressing when they built that view.
  - deepl_derber 6y ago
    I think the UX around the trash bin is pretty good and I've always found the quota pane useful.

kyrra 6y ago

(Googler, opinions are my own). I also don't work on drive, these are my rough understanding of things. There may not be a way to do this yet, but hopefully should be coming someday. One key thing to understand is that Google Drive seems to be implemented as a graph, not a tree. This becomes apparent when you realized that any item (folder or file) could be placed into multiple directories on your drive. This allowed for cycles and lots of other crazy things within the filesystem (as you aren't guaranteed to have a single parent folder). Now, this behavior finally changed in Sept 2020[1], and they are backfilling all mutli-links to be shortcut (symlink) based. This should finally allow for proper directory navigation and determining size. It also fixes all kinds of other problems that a graph file system causes. [1] https://cloud.google.com/blog/products/g-suite/simplifying-google-drives-folder-structure-and-sharing-models https://cloud.google.com/blog/products/g-suite/simplifying-g...

CarelessExpert 6y ago
> This allowed for cycles and lots of other crazy things within the filesystem (as you aren't guaranteed to have a single parent folder). That doesn't prevent a folder size calculation. It does mean you need to do a graph traversal, and you might need to supplement the feature with a visualization akin to what you get from windirstat/baobab/etc, so users know what's factoring into the calculation. It also likely means this isn't an instantaneous operation, but again, I look at windirstat/baobab as examples for how to present a UX that's workable. But that doesn't prevent the feature from being built, and the fact that rclone already has it says to me the gdrive team has simply chosen not to make this functionality available.
- kyrra 6y ago
  I agree that it doesn't prevent it. Traversing a graph is a simple compsci problem, but optimizing it is more complicated. My guess is that it prevent caching of folder sizes, so any size checks require full graph walks, which are not cheap.
  - kyrra 6y ago

jerrac 6y ago

Here are my thoughts on the issue. (To be clear, my thoughts have no input from my workplace.) A) Why wasn't proper usage reporting built in from the start? If you are limiting a user by a usage metric, then you should be giving them a way to manage that usage intelligently. It does sound like Drive is a complicated structure, but, well, that's no excuse for not supporting your users properly. B) I'm not surprised by Google ending the unlimited plan. But I still consider it bait and switch. Promising "unlimited" in the first place is impossible. It's false advertising. All the companies that do, or did, that, really should be fined. At very least we should hit them with a class action. C) Google's method of ending the unlimited plan is not very good. They really should have done something like: "We are ending the unlimited plan. New users will receive 100TB. Current users with more than 100TB of data will be granted a perpetual 120% of their current data usage as of last night at midnight UTC. Current users with less than 100TB, will have a 120TB limit." That would have been far more fair, and much less of a bait and switch. Anyway, thanks to everyone who replied. The tips about rclone really helped out.