There are multiple (advanced) projects to get the next 10-100X of perf beyond this via in-memory & streaming GPU computing over columnar data. And... they're ta

There are multiple (advanced) projects to get the next 10-100X of perf beyond this via in-memory & streaming GPU computing over columnar data. And... they're taking RDDs in as native formats, and some even target sql as the scripting lang :) FWIW, my interest here is what becomes possible for sub-second computations. We do interactive analytics, and GPUs become exciting for that, including in the distributed case :) Similar story for stuff like VR, real-time ML, etc.