I wonder if Arrow (https://arrow.apache.org/faq/ https://arrow.apache.org/faq/) would work for this: "The Arrow IPC mechanism is based on the Arrow in-memory f

I wonder if Arrow (https://arrow.apache.org/faq/ https://arrow.apache.org/faq/) would work for this: "The Arrow IPC mechanism is based on the Arrow in-memory format, such that there is no translation necessary between the on-disk representation and the in-memory representation. Therefore, performing analytics on an Arrow IPC file can use memory-mapping, avoiding any deserialization cost and extra copies."