4 ms·

How about Spark + Parquet via SQLContext / SchemaRDD?

• alecco 11y ago
  The overhead of that must be ridiculous.
  • pacala 11y ago
    What kind of overheads should we be aware of? Spark can run on a single machine, it could be an interesting benchmark to compare against Vertica or similar products. I've seen similar systems tuned for under 1s response times, even when running in distributed mode, though they were proprietary.