To clarify, what I mean is that working with "exabytes" is atypical. Most use cases are at a slightly smaller scale :) Data processing workloads are quite comm

To clarify, what I mean is that working with "exabytes" is atypical. Most use cases are at a slightly smaller scale :) Data processing workloads are quite common on Ray, especially with unstructured data. Also, I work on Ray, which is the underlying framework used here, but all the work in the post was done by the Amazon team.