4 ms·
Which of the shinier, newer solutions do you think people have found more attractive in particular? Genuinely curious, thanks!
by heyyyouu 7y ago
Which of the shinier, newer solutions do you think people have found more attractive in particular? Genuinely curious, thanks!
- notyourday 7y agoI'm not someone very much in the "big data" [0] but from what I see streaming analytics especially Spark-based solutions are eating the world that used to be dominated by Hadoop. I also think cloud based data lakes and tooling around them seriously decreased the appeal of Hadoop. [0] If I can fit your big data into my memory, it is not "big data".
- brokensegue 7y agoi mean spark is often deployed on top of yarn where it's still in the "hadoop" sphere.
- notyourday 7y agoBut I'm not loading up on my SuperMicro, Dell or HP servers. So there's no need to buy a decent Hadoop implementation from MapR.
- threeseed 7y agoSpark is very much part of Hadoop. It uses Hadoop libraries throughout it including for the core part of reading/writing data And that adage of big data can't fit in memory is nonsense these days. We run clusters with hundreds of terabytes of RAM which is very much big data. It's pretty easy and affordable with the cloud.
- notyourday 7y agoWhen was the last time you bought a MapR license to use it in a cloud? When MapR was selling them the M5 and M7 were deployed in a data center on servers.