3 ms·
Datafusion has better support for object_store api (you can just register the store and pass it s3 uris). With polars, you have to have the file on the local f
by jmartin2683 4y ago
Datafusion has better support for object_store api (you can just register the store and pass it s3 uris). With polars, you have to have the file on the local file system (which I’ve found to be a huge performance win, cacheing them anyway).