3 ms·
we use it, but (after reading the homepage linked to at the bottom) pretty clearly outside the core use case. In particular, we use it for off-heap caching, whi
by doug1001 11y ago
we use it, but (after reading the homepage linked to at the bottom) pretty clearly outside the core use case. In particular, we use it for off-heap caching, which we configure through org.apache.spark.StorageLevel. We monitor via tachyoneFolderName which as you probably know is a spark context (sc) attribute (eg, ./bin/spark-shell, then type "sc."[Tab] to find it).