3 ms·
CuVec: Unifying Python/C++/CUDA memory
- flakiness 5y agoIIRC Apache Arrow [1] promised similar goal and it seems covers CUDA as well [2]. I wonder how these relates in the big picture. This one seems much simpler than arrow, which is probably a good thing in terms of the differentiation? - [1] https://arrow.apache.org/ https://arrow.apache.org/ - [2] https://arrow.apache.org/docs/python/cuda.html https://arrow.apache.org/docs/python/cuda.html
- swalsh 5y agoI have this irrational reaction to any apache managed project to instantly reject it. I've just been burned so many times by software that isn't ready for prime time.
- alzaeem 5y agoThe Apache Arrow project is led by the creator of Pandas, which is one of the most important packages in the Python ecosystem. I agree Apache has some half-baked projects, but I think Arrow has the track record and backing to achieve its goals
- pantsforbirds 5y agoArrow (& by extension parquet) are both amazing projects. I think the apache foundation has quite a few projects that are worth considering. Arrow, Airflow, Beam, Cassandra, Flink HBase, Hive, Kafka, Lucene, ORC, Pig, etc. Really their database, data processing, etc. work has been great imo
- kristjansson 5y agoThis one seems to be a very thin interface over raw buffers, with the CUDA runtime managing the hard parts of migrating to device(s) and back. Pretty neat to offer natural interfaces to that sort of managed memory, but necessarily low-level. Anything more expressive than (automagically-migrated) arrays of primitives is up to the programmer.