3 ms·
Not only in between processes, but also in between languages in a single process. In this POC I spun up a Python interpreter in a Go process and pass the Arrow
by poorman 6y ago
Not only in between processes, but also in between languages in a single process. In this POC I spun up a Python interpreter in a Go process and pass the Arrow data buffer between processes in constant time. https://github.com/nickpoorman/go-py-arrow-bridge https://github.com/nickpoorman/go-py-arrow-bridge
- cdash 6y agoHow is this any better than something like flatbuffers though?
- mrfox321 6y agoFor one, Arrow is columnar. The idea of zero-copy serialization is shared between Arrow and FlatBuffers.
- asperous 6y agoThis is explained in the FAQS for Arrow, saying they use flatbuffers internally. Arrow supports more complex data types
- tomnipotent 6y ago> saying they use flatbuffers internally Only for IPC support - Arrow data format does not use flatbuffers.