2 ms·
> Calling UDFs from SQL means you can create great features for SQL analysts You can do that in Spark, no?
by victor106 6y ago
> Calling UDFs from SQL means you can create great features for SQL analysts
You can do that in Spark, no?
- jpau 6y agoYou sure can :) I see it as why the article supports Databricks as an RDBMS; it offers something others do not. You can't currently* do the same extensive UDFs in Snowflake or BQ and, sometimes, they are important. But with SnowPark coming, hopefully you won't have to make such a large sacrifice to SQL users' experience for it. * Currently you can do JavaScript UDFs and external functions in Snowflake, and BigQuery ML is worth mentioning here too. Those cover some, but not all, of what you might use a Spark UDF for in SQL.