3 ms·
One thing I found interesting is the logical type system doesn't seem to include sum types or unions, unlike Arrow etc. I'd generally encourage new type system
by andyferris 11mo ago
One thing I found interesting is the logical type system doesn't seem to include sum types or unions, unlike Arrow etc.
I'd generally encourage new type systems to include sum types as a first-class concept.
- infogulch 11mo agoI wonder if a columnar storage format should implement sum types with a struct of arrays where only one array has a nun-null value for each index.
- ozgrakkurt 11mo agoArrow has two variants of it and this is one of them. Other variant has a seperate offsets array that you use to index into the active “field” array, so it is slower to process in most cases but is more compact