3 ms·
I strongly prefer `dplyr` and the R stack for table processing and visualization. But, recently I’ve been working with much larger scale data than R can handle
by j_bum 1y ago
I strongly prefer `dplyr` and the R stack for table processing and visualization.
But, recently I’ve been working with much larger scale data than R can handle (thanks to R’s base int32 limitation) and have been needing to use Python instead.
Polars feels much more intuitive and similar to `dplyr` to me for table processing than Pandas does.
I often ask my LLM of choice to “translate this dplyr call to Polars” as I’ve been learning the Polars syntax.
- aydyn 1y agoIt blows my mind that in 2025 R is still limited to 2^31-1 rows. R needs a Python 3.0 moment, but that is unfortunately not going to happen for certain unfortunate but unnecessary reasons.
- j_bum 1y agoYep. I have a deep love/hate relationship with R. This is one of those decisions that I just do not understand. In your mind, why do you imagine a set of improvements won’t be made? Otherwise, for now, working with Python and R using the reticulate package in Quarto is perfect for my needs. If the Positron IDE could get in-line plot visualization in Quarto documents like the RStudio IDE has, I’d be the happiest camper.