Okay, I've been playing around with ASDF a bit and I kinda really like it! It's quite performant - about 40% slower than reading/writing TIFFs, but supporting a

Okay, I've been playing around with ASDF a bit and I kinda really like it! It's quite performant - about 40% slower than reading/writing TIFFs, but supporting arbitrary metadata and array sizes. Supports in-band compression with zlib (ok), bzip2 (slow AF), and lz4 (quite fast, only about 50% slower than no compression, so in line with lz4 compressing the raw data). There's a couple of squicky things, for one, it looks like the extension model may allow RCE behaviors by deserializing arbitrary classes. It looks like it uses a URI/registration based system so by default, it is limited in what types it can try to load, but it's plugin-based, so a library you import could theoretically expose you. But that seems relatively low risk. But overall this format is really cool. Supports linking across multiple ASDF files, which I can see getting messy, but this is an incredibly powerful technique and they do it in a sane way.