3 ms·
Excited to see this release's official inclusion of the pure Julia Arrow implementation [1]! It's so cool to be able mmap Arrow memory and natively manipulate
by jrevels 6y ago
Excited to see this release's official inclusion of the pure Julia Arrow implementation [1]!
It's so cool to be able mmap Arrow memory and natively manipulate it from within Julia with virtually no performance overhead. Since the Julia compiler can specialize on the layout of Arrow-backed types at runtime (just as it can with any other type), the notion of needing to build/work with a separate "compiler for fast UDFs" is rendered obsolete.
It feels pretty magical when two tools like this compose so well without either being designed with the other in mind - a testament to the thoughtful design of both :) mad props to Jacob Quinn for spearheading the effort to revive/restart Arrow.jl and get the package into this release.
[1] https://github.com/JuliaData/Arrow.jl https://github.com/JuliaData/Arrow.jl
- StefanKarpinski 6y agoEspecially impressive that the first official version ships with such broad feature coverage! Really great work by Jacob.
- andyferris 6y ago> a separate "compiler for fast UDFs" is rendered obsolete Agreed. I am excited too. Thanks Jacob!