A lot of it is just trying to build a more modular Spark. Which is nice and all but for most companies they want something integrated so a lot of these project

A lot of it is just trying to build a more modular Spark. Which is nice and all but for most companies they want something integrated so a lot of these projects despite promises haven't really seen that much traction. Especially when every cloud provider has a fully supported Spark platform available.