3 ms·
> SparkSQL doesn’t support gz Yes it does. Source - use Spark SQL routinely. You're right that multiple small Gzipped files are not an ideal input source as it
by EdwardDiego 8y ago
> SparkSQL doesn’t support gz
Yes it does. Source - use Spark SQL routinely. You're right that multiple small Gzipped files are not an ideal input source as it'll create a bunch of small tasks, but Spark definitely does support GZ.