4 ms·
Druid has a SparkSQL connector: https://github.com/SparklineData/spark-druid-olap https://github.com/SparklineData/spark-druid-olap
by fangjin 11y ago
Druid has a SparkSQL connector: https://github.com/SparklineData/spark-druid-olap https://github.com/SparklineData/spark-druid-olap
- joefkelley 11y agoCool! Yeah I poked around the druid site and didn't find anything originally, but this looks pretty promising. It's hard to tell how full-featured it is without getting hands-on, but I see something like this making Druid much more usable in a lot of analytics environments.
- hbutani 11y agoWe have couple of companies running Tableau on top of this. The deployment is Tableau - Spark ThriftServer(with our extension) - Druid. We push down Slice and Dice and Star Join Queries as Druid Queries; all of Spark SQL is supported with some portions of a Query Plan being executed in Spark. We are working on supporting more Spark UDFs being pushed to Druid, performance improvements, and more coverage for Tableau. Further down we will support Star Schemas where some or all dimensions are not indexed. Happy to discuss specific SQL support or deployment questions. Please reach out to us. - Harish.