3 ms·
Arrow had it selling points as non-serde. But I am wondering how does it achieve no-serde with Python? By allocating PyObject cleverly with a network packet buf
by est 6y ago
Arrow had it selling points as non-serde. But I am wondering how does it achieve no-serde with Python? By allocating PyObject cleverly with a network packet buffer?
If I convert an Arrow int8 array to normal python list of int's, will this involve copying?
- int_19h 6y agoI think the idea is that you'd have a Python object that behaves exactly like a list of ints would, but with Arrow as its backing store.
- kylebarron 6y agoThis is similar to Numpy. You operate on Python objects that describe the Numpy structure, but the actual memory is stored in C objects, not Python objects.
- dahinds 6y agoIt would have to, but to a numpy vector, maybe not.