3 ms·
Most stream processing doesn’t rely too much on RAM, unless you literally need all the data in memory at the same time.
by Aeolun 8y ago
Most stream processing doesn’t rely too much on RAM, unless you literally need all the data in memory at the same time.
- groestl 8y agoIf it _needs_ to be in RAM, then either you got a big enough machine (then by definition it's not Big Data) or it's impossible. If you manage to come by with RAM using smart algorithms, although the full dataset would never fit in RAM, then it's Big Data. So I'd argue, stream processing is Big Data, exactly because it doesn't rely too much on RAM.
- Aeolun 8y agoTrue, but I can stream process 20GB of data on my tiny 2GB RAM home server as well. That’s not really ‘big data’ in my opinion.