3 ms·
I believe Vaex can do this, in addition to GPU processing and reading direct from s3. https://github.com/vaexio/vaex https://github.com/vaexio/vaex
by alexisread 5y ago
I believe Vaex can do this, in addition to GPU processing and reading direct from s3.
https://github.com/vaexio/vaex https://github.com/vaexio/vaex
- pvitz 5y agoTo you and all the other sibling comments: Thanks a lot! Exactly what I have been looking for! With regard to Vaex, I would really be interested in an independent benchmark comparing it to dask, spark, data.table etc. However, I have seen in the comments that others also can't find that.
- chrisaycock 5y agoThe H20 benchmarks cover Dataframe operations: https://h2oai.github.io/db-benchmark/ https://h2oai.github.io/db-benchmark/ It has pandas, dask, Spark, data.table, Polars, etc. Sadly, Vaex is currently missing from this suite.