3 ms·
The StringView/ListView and REE optimizations are already part of Arrow, and should be usable with Datafusion (Datafusion just uses Arrow datatypes everywhere).
by yencabulator 3y ago
The StringView/ListView and REE optimizations are already part of Arrow, and should be usable with Datafusion (Datafusion just uses Arrow datatypes everywhere).
https://docs.rs/datafusion/latest/datafusion/common/arrow/array/type.StringViewBuilder.html https://docs.rs/datafusion/latest/datafusion/common/arrow/ar...
https://docs.rs/datafusion/latest/datafusion/common/arrow/datatypes/enum.DataType.html https://docs.rs/datafusion/latest/datafusion/common/arrow/da...