3 ms·
I think the problem is that people don't really appreciate how big your data has to be to be Big Data.
by solidasparagus 6y ago
I think the problem is that people don't really appreciate how big your data has to be to be Big Data.
- JulianMorrison 6y agoTo be fair that threshold has risen substantially since the paper out of Google that kicked the whole thing off in 2003.
- mumblemumble 6y agoWell, there is that. But, rewind 10 or 15 years to when Big Data was really taking off, and the world was also different in ways that meant that your data didn't need to be nearly so big, even after adjusting for hardware advances, to qualify as Big. Most the programming platforms and libraries that one might choose instead of Hadoop & friends didn't exist back then, or weren't or weren't particularly robust. So there weren't a lot of games other than Java in town. And Java (idiomatic Java, not benchmark-friendly Java) tends to reduce the volume of work you can squeeze out of a given hardware setup by introducing a hefty does of memory overhead.