13 ms·
Wait, do you insert the data from S3 into duckdb? I was just doing select from file.
by aynyc 1y ago
Wait, do you insert the data from S3 into duckdb? I was just doing select from file.
- fastasucan 1y agoMaybe its your terminal that chockes because it tries to display to much data? 500GB should be no problem.
- broner 1y agoNope, just reading from S3. Check this out: https://duckdb.org/2024/07/09/memory-management.html https://duckdb.org/2024/07/09/memory-management.html