4 ms·
I've been using R for years. A month ago I tried to port a program we use that takes 20MB CSV files and finds trends. In R, it would take around 5 second to rea
by WhyDoPeople 9y ago
I've been using R for years. A month ago I tried to port a program we use that takes 20MB CSV files and finds trends. In R, it would take around 5 second to read the file and give me my data. In Julia it took 30 seconds.
Is this a common occurrence?
- StefanKarpinski 9y agoHow did you load it? CSV.jl and TextParse.jl are the go-to fast ways to load CSV data. They used to be trying to catch up with Pandas which was the fastest CSV parser, but now I think they're in a friendly arms race with each other, having passed Pandas CSV parsing half a year ago.
- baldfat 9y agoAlso are you using read_csv in R from the library readr? The 5 seconds seems slow to me. https://github.com/tidyverse/readr https://github.com/tidyverse/readr