2 ms·
Are there lightweight solutions to reading parquet files in Python? Any time I want to deal with parquet in AWS lambda I have to deal with the entire Pandas sui
by scrollaway 7y ago
Are there lightweight solutions to reading parquet files in Python? Any time I want to deal with parquet in AWS lambda I have to deal with the entire Pandas suite which is a pain on lambda.
- cavisne 7y agoOne interesting way is to use S3 Select which can read parquet, then you just need a dependency on the AWS sdk