4 ms·

You can open an s3 object as a 'file object' in python and it is at least seekable. Other than that I think you're best to treat s3 as a huge kv store and not

You can open an s3 object as a 'file object' in python and it is at least seekable. Other than that I think you're best to treat s3 as a huge kv store and not a filesystem at all.

dontlaugh 4y ago
Seek only works because the whole object gets downloaded into memory first.
- rbanffy 4y ago
  Either that, or the Unix principle of many small files being better than a single big one (without the need to worry about inode exhaustion in S3).
  - dontlaugh 4y ago
    S3 works best with a bunch of medium and similar sized files. It’s really not like a file system.
    - RantyDave 4y ago
      Right. Big and slow kv.
    - rbanffy 4y ago
      Reminds me of tape-based storage like the Sinclair QL or Exatron's "stringy floppy". Or Mitsumi's QuickDisk, a format I saw on the Sharp MZ series which is not a disk, but a spiral track that looks a lot like a loop of tape running past RW heads.