Hadoop isn't require and it only run better if you fit data in memory. Spark does micro batch processing where as Hadoop traditionally does batch processing. H

Hadoop isn't require and it only run better if you fit data in memory. Spark does micro batch processing where as Hadoop traditionally does batch processing. Hadoop yarns is different now and even with old Hadoop if you can fit it into memory it can be supposely as fast according to a meetup I've attended. There's also Apache Flink by data artisan.