One cool library I saw recently for helping on the visualisation side is https://github.com/vegafusion/vegafusion https://github.com/vegafusion/vegafusion It a

One cool library I saw recently for helping on the visualisation side is https://github.com/vegafusion/vegafusion https://github.com/vegafusion/vegafusion It allows you to use Altair in Python for visualising data, but does the computation in the backend using Arrow DataFusion. Not for 15GB perhaps, but cool nonetheless.