3 ms·
What a stupid headline. They use Alluxio (formerly named Tachyon). People who know anything about Spark will already know what that means. For everyone else it
by nl 11y ago
What a stupid headline.
They use Alluxio (formerly named Tachyon). People who know anything about Spark will already know what that means. For everyone else it is an out of JVM memory layer that allows Spark to keep more data in memory instead of disk.
The key quote is that it is 100x than Spark alone. It isn't instead of Spark SQL, it's as well as.
- dang 11y agoOk, we changed the headline to the subtitle (or the part that would fit). If anyone suggests a more accurate and neutral title, we can change it again.
- rxin 11y agoIt's also not 100X faster than "Spark alone". This article is plain wrong.
- eranation 11y agoTo those who don't know rxin, (Reynold Xin) he is a cofounder of databricks and a spark prominent maintainer, I would listen to him.