4 ms·
More and more I reach for pyspark for medium sized tasks because I like the API and if I need to scale it I can. I don't think this is as black and white as it
by pcarolan 9y ago
More and more I reach for pyspark for medium sized tasks because I like the API and if I need to scale it I can. I don't think this is as black and white as it used to be now that big data framework interfaces are getting as good or better than small data interfaces.