2 ms·
Yeah, or R. When I need to do stuff bigger than RAM on a laptop I just reach for sqlite (assuming it can even fit on disk).
by Groxx 8y ago
Yeah, or R. When I need to do stuff bigger than RAM on a laptop I just reach for sqlite (assuming it can even fit on disk).
- gaius 8y agoThe funny thing is we didn’t even consider our 50Tb to be particularly big, we knew guys running 200Tb... BTW in R data.table is better for larger datasets than the default dataframe... or use the Revolution Analytics stuff on a server.
- Groxx 8y agoOh yeah, the default dataframe is practically only for toy problems / very-already-filtered data (which accounts for a LOT of useful scenarios!). It's more that I've run into "big data" people who (╯°□°)╯︵ ┻━┻ when the default settings + dataframe choke, which is around 200MB of heap.