2 ms·
The funny thing is we didn’t even consider our 50Tb to be particularly big, we knew guys running 200Tb... BTW in R data.table is better for larger datasets th
by gaius 8y ago
The funny thing is we didn’t even consider our 50Tb to be particularly big, we knew guys running 200Tb...
BTW in R data.table is better for larger datasets than the default dataframe... or use the Revolution Analytics stuff on a server.
- Groxx 8y agoOh yeah, the default dataframe is practically only for toy problems / very-already-filtered data (which accounts for a LOT of useful scenarios!). It's more that I've run into "big data" people who (╯°□°)╯︵ ┻━┻ when the default settings + dataframe choke, which is around 200MB of heap.