4 ms·
PySpark is a wrapper, so Scala is unnecessary and boggy.
by tomrod 1y ago
PySpark is a wrapper, so Scala is unnecessary and boggy.
- spark1377485 1y agoPySpark is great, except for UDF performance. This gap means that Scala is helpful for some Spark edge cases like column-level encryption/decryption with UDF