4 ms·
> Zero copy state transfer is a viable and high performance alternative. Completely agreed, but also, adding my own emphasis there. The technique has has enou
by mumblemumble 3y ago
> Zero copy state transfer is a viable and high performance alternative.
Completely agreed, but also, adding my own emphasis there.
The technique has has enough gotchas, edge cases, and additional security considerations that it should really be an alternative that people can opt for when they need it, and never be the default approach.
- chaokunyang 3y agoYes, it should be an alternative. In fury, we disabled it by default, and all those benchmarks doesn't enable it. Most objects are value bounded, not binary data bounded. Zero-copy won't have a big speed up too. But if the objects graph has many ByteBuffer/Tensor/DataFrame/ArrowTable, then the zero-copy will have a big leap. see python pickle5 out-of-band serialization to speed up pandas/numpy as an example