3 ms·
spark is far more testable and composable than sql! and you even get static typing checking. plus i can read data from anywhere - local fs, s3, rdbms, json, p
by hrkfmud50k 5y ago
spark is far more testable and composable than sql! and you even get static typing checking. plus i can read data from anywhere - local fs, s3, rdbms, json, parquet, csv... rdbms could not compete
- dreyfan 5y agoYou’re really proving my point that spark developers have no clue what they’re doing. Keep it up, I’ll keep taking your jobs and cleaning up your mistakes.
- adrianN 5y agoMany (most?) DBs have no problem ingesting json, parquet, csv etc from S3. Some can query those formats without first ingesting them.