4 ms·
To_feather and from_feather are a wonderful addition if you use R and Python, or have a mixed language data science shop.
by tomrod 6y ago
To_feather and from_feather are a wonderful addition if you use R and Python, or have a mixed language data science shop.
- x87678r 6y agoYes but is it any better than parquet or hdf? edit - this looks a good explanation, parquet is more widely used and smaller, but slower. https://stackoverflow.com/questions/48083405/what-are-the-differences-between-feather-and-parquet https://stackoverflow.com/questions/48083405/what-are-the-di...
- kylebarron 6y agoThe compression improvements in Parquet can be really great, especially for large, wide tables where you might only need a few columns for analysis.
- tomrod 6y agoHdf I've not used in any production workflow. Parquet I've really only used with impala. If I'm working in that system I'm in Spark already, typically.