3 ms·
Super cool. Perhaps naive, but how does distributing computation with serialization square with Arrow's in-memory design?
by blittable 7y ago
Super cool. Perhaps naive, but how does distributing computation with serialization square with Arrow's in-memory design?
- andygrove 7y agoEach executor within the cluster would use Arrow in-memory design. If you have enough cores and memory on a single node then potentially you wouldn't need a cluster.