3 ms·

There are lots of "table" like solutions out there: R's data.frame and data.table are obvious examples. Speed, the ability to persist data as an actual databa

There are lots of "table" like solutions out there: R's data.frame and data.table are obvious examples. Speed, the ability to persist data as an actual database system, and the ability to work with data "out of core" would be the advantages over Pandas. I'll be releasing various performance comparisons over coming weeks to demonstrate these advantages.

yummyfajitas 11y ago
Cool, any chance you'll write a blog post discussing that? Being a good column oriented DB combined with a decent vectorized language is definitely not something so easy to find - blaze purports to be that system (sort of), but it isn't really living up to the hype.
- scottlocklin 11y ago
  Of course we'll blog on this topic! Just not today. That's what the APL world brings to the table. FWIIW, you can read about my comparing Jd (another APL related columnar database) to a Blaze like tool (Spark bigDF) on the J list: http://jsoftware.com/pipermail/database/2015-May/000076.html http://jsoftware.com/pipermail/database/2015-May/000076.html