Very much depends on how large you're talking, but check out Apache Arrow: https://observablehq.com/@theneuralbit/introduction-to-apache-arrow https://observabl

Very much depends on how large you're talking, but check out Apache Arrow: https://observablehq.com/@theneuralbit/introduction-to-apache-arrow https://observablehq.com/@theneuralbit/introduction-to-apach... https://observablehq.com/@uwdata/arquero-and-apache-arrow https://observablehq.com/@uwdata/arquero-and-apache-arrow