3 ms·
All programming languages should have a PyArrow-backed DataFrame data structure. After working with DataFrames in Python or Spark, you'll never want to go back
by MrPowers 5y ago
All programming languages should have a PyArrow-backed DataFrame data structure. After working with DataFrames in Python or Spark, you'll never want to go back to manipulating nested arrays.
Ruby, Go, Scala, Java should all build these libs (Scala has Spark for cluster computing, but it needs a good Pandas-like single node lib) to attract the data engineers. I'd imagine it's relatively easy to add DataFrame support now cause PyArrow does the heavy lifting.