3 ms·
I think you are describing something close to the Dataset API in Spark. Spark is built on the RDD, a novel data structure that creates transparent concurrency a
by nikhizzle 7y ago
I think you are describing something close to the Dataset API in Spark. Spark is built on the RDD, a novel data structure that creates transparent concurrency and distribution. Additionally, you can access the same data with 4 APIs, one of which is SQL, and another which is a typed functional API.
The RDD paper is one of my favorite papers, and is great bed time reading.
https://www.usenix.org/system/files/conference/nsdi12/nsdi12-final138.pdf https://www.usenix.org/system/files/conference/nsdi12/nsdi12...