3 ms·
> The RDD programming model provides only distributed collections of object It is ok for a non-technical high level overview but RDD should probably be referre
by techno_modus 10y ago
> The RDD programming model provides only distributed collections of object
It is ok for a non-technical high level overview but RDD should probably be referred to as a data model (how data is represented and managed) while map-reduce is a programming model (how data is being processed).
- kod 10y agoNo, the rdd interface has methods on it that directly relate to how data is processed.
- techno_modus 10y agoYou are right, but what I meant is that delta between Spark and Hadoop is RDD (RDD - Resilient Distributed Dataset) which is data structure first of all. Thus Spark and Hadoop have the same data processing model implemented over different data representation models (and hence the performance gain).
- marmaduke 10y ago> delta why can't we use the word difference? delta, mathematically, suggest some space and measure.