4 ms·

Dask does not have "experimental Arrow integration". It supports using Arrow to read Parquet files but no Arrow-based computational functionality.

• arijun 7y ago
  Thanks for the clarification, Wes! Semi-related question: How do you expect Arrow to be integrated to the larger data science landscape? Will it mostly be used as a go between format? Will new libraries using it internally and old libraries just reading and translating it to a native format? Do you think established libraries will change their back-end to arrow? Is that even feasible with e.g. Pandas (or are you too far from their governance now to say)?
  • wesm 7y ago
    Too big of a discussion for Hacker News! Come on dev@arrow.apache.org if you want to talk about it
    • sandGorgon 7y ago
      thanks for correcting me. i was not aware of this nuance. would you be open to posting quick thoughts here for the rest of us ?
      • wesm 7y ago
        No. If you want to talk about it come on the Apache Arrow mailing list