4 ms·
How does it compare with spark SQL? Does the difference lie in where the query runs? In spark it loads all data into memory first and then uses SQL to query it
by eranation 11y ago
How does it compare with spark SQL? Does the difference lie in where the query runs? In spark it loads all data into memory first and then uses SQL to query it (it parses the query and converts it to a set of spark transformations, kind of like hive). Does Drill actually translate SQL into, for example, mongo db native queries and run it on the source data store? If so this is a whooping amazing feat...
- hurin 11y agoHow hard is it to translate syntaxes? p.s. Will translate syntaxes, $250 per.
- rxin 11y agoActually Spark SQL doesn't load everything into memory. Its data source API supports pushing predicates down, and if the data sources implement it, it even supports running aggregations and joins in the data sources!
- MasterScrat 11y agoI would really be interested in a comparison of BI tools performances using the JDBC/ODBC drivers from Spark vs Drill.