3 ms·
I would argue that the fact that Arrow has been integrated into so many projects over the last year is proof that a separate project made sense. Dremio, PySpark
by tshiran 9y ago
I would argue that the fact that Arrow has been integrated into so many projects over the last year is proof that a separate project made sense. Dremio, PySpark, Pandas, MapD, NVIDIA GPU Data Frame, Graphistry, Turbodbc, ...
- rch 9y agoHere's the conclusion of the article: It makes sense to keep Arrow and Parquet/ORC as separate projects, while also continuing to maintain tight integration. You might enjoy reading it to see why.
- ineedasername 9y agoWell... use in projects is an indicator, not a proof, of utility. Not all choices are good ones, inferior & redundant products are crop up on a regular basis, and to the dismay of many in this community, sometimes win out. Happily, from the article, Arrow, doesn't appear one of them, and has its own unique and justified niche.