3 ms·
I've written a fair bit of PySpark code and Polars's syntax feels fairly similar, but it also offers a limited SQL dialect.
by rubinelli 2y ago
I've written a fair bit of PySpark code and Polars's syntax feels fairly similar, but it also offers a limited SQL dialect.
- chrisjc 2y agoAlthough only experimental and probably off topic to the discussion, it's worth mentioning DuckDB also provides a Spark API implementation. https://duckdb.org/docs/api/python/spark_api https://duckdb.org/docs/api/python/spark_api And while on the subject of syntax, duckdb also has function chaining https://duckdb.org/docs/sql/functions/overview.html#function-chaining-via-the-dot-operator https://duckdb.org/docs/sql/functions/overview.html#function...