3 ms·
I love R. But working with 50 million rows in ram is a pain. Anyway to do it differently? I use data.table BTW, so asfactor is always false
by stilisstuk 6y ago
I love R. But working with 50 million rows in ram is a pain. Anyway to do it differently? I use data.table BTW, so asfactor is always false
- jointpdf 6y agoFor what purpose? There are tons of ways to do it differently, see here: https://cran.r-project.org/web/views/HighPerformanceComputing.html https://cran.r-project.org/web/views/HighPerformanceComputin...
- scottlocklin 6y agoBuy more ram? If you're regularly running into memory performance issues despite using data.table, and you don't feel like fiddling with mmap, consider looking into an APL variant.
- stilisstuk 6y agoWill look into mmap. Thx