4 ms·
I definitely agree that it'd be great to decouple the improvements in software and drops in cloud pricing. In reality it is pretty difficult because the Nanjing
by rxin 10y ago
I definitely agree that it'd be great to decouple the improvements in software and drops in cloud pricing. In reality it is pretty difficult because the Nanjing U/Alibaba team spent a lot of time also optimizing the software specifically for the AliCloud environment, which might not be applicable when running on Amazon EC2, which was the environment of the 2014 record.
This is a great task for a rigorous academic paper!
Disclaimer: I wrote the blog post.
- wsmith 10y agoIs Spark faster than MemSQL?
- gopalv 10y agoMemSQL is a transactional database (system of record). Spark is a way of processing data, ideally stored in a system of record (Hive/HDFS/S3/MemSQL etc). They're not the same.
- wsmith 10y agoThere are similarities. A database is also a way of processing data. For the kinds of processing both Spark and MemSQL do (e.g. join operation) is Spark faster than MemSQL?