3 ms·
Snowflake and Pandas already have the ability to decode/encode "logical" type information stored in a Parquet file header, which is how you can do things like r
by nerdponx 2y ago
Snowflake and Pandas already have the ability to decode/encode "logical" type information stored in a Parquet file header, which is how you can do things like round-trip categorical-dtype data and data frame indexes between Pandas and Parquet. So I think things are already heading in that direction, but a coherent vision is absolutely necessary to keep it up and drive adoption.