3 ms·
Parquet is an open format. It’s part of the Apache foundation. Would have preferred CSV as well, though, easier to work with. There’s also a little known featu
by sudhirj 7y ago
Parquet is an open format. It’s part of the Apache foundation.
Would have preferred CSV as well, though, easier to work with. There’s also a little known feature called S3 Select that allows you to run SQL on S3 files and selectively retrieve data, which is what Parquet is for in the first place.
- etaioinshrdlu 7y agoCan you load that dump using any open source tools outside of AWS and recreate the database identically? Because you can do that with mysqldump.
- derision 7y agoI don't think this is meant for recreating the database, but rather exporting large sets for analysis somewhere else. But as far as tools yes, parquet can be parsed by any tool that knows the format. It's not too uncommon