4 ms·
Haha 3.9Gb, thats nothing. I'd argue that anything that can fit into ram of a relatively modern laptop is small data.
by bobowzki 12y ago
Haha 3.9Gb, thats nothing. I'd argue that anything that can fit into ram of a relatively modern laptop is small data.
- bigiain 12y agoThe word around here is "if it fits onto a computer you own, it's not 'big data'". I'd look strangely at anyone claiming "big data" for anything smaller than double digit terabytes.
- IndianAstronaut 12y agoYeah. I would hesitate to call anything under 60 terabytes as big data.
- minimaxir 12y agoThis is an interesting point because the typical amount of RAM in a modern computer is 8GB, with 16GB being a rare upgrade. For data analyses which I've done, my 8GB computers will complain when analyzing 2-3GB datasets because when processing the data, the computers needs to make a copy in memory, since the analysis isn't in-place, and there are memory leaks (stupid R). So 4GB-6GB of memory usage causes hangs (since the OS is using a lot of memory too) and is why I've had to resort to SQL for data sets that hit that size. (which is perfectly fine)