This is absolutely sneaky and would work. I believe S3 also has file access cost but it's minimal. If you had a partitioned list of what you needed to move pe

This is absolutely sneaky and would work. I believe S3 also has file access cost but it's minimal. If you had a partitioned list of what you needed to move per node, so that coordination was minimal between them, this would be pretty viable.