3 ms·

Ugh really? Why would they not hash the whole filename for shard assignment?

• bowmessage 5y ago
  Because the file name includes the "directory" prefix, i.e. each file's name stores the `/entire/bucket/dir/tree`, which can get large.
  • manigandham 5y ago
    The size of the input doesn't affect the hashing.
    • bowmessage 5y ago
      It affects the runtime of the hashing.
• mmoskal 5y ago
  In these systems you typically can list blobs based on prefix. If you shard blobs sharing prefix to different nodes that becomes difficult.