3 ms·
They used gcsfuse. It lets you mount GCS buckets as filesystem mounts and do reads/writes on objects, from GCE hosts. gcsfuse is quite fast. It also caches fi
by dekhn 10y ago
They used gcsfuse. It lets you mount GCS buckets as filesystem mounts and do reads/writes on objects, from GCE hosts.
gcsfuse is quite fast. It also caches files locally, if you ask it to. So, presumably, subsequent jobs access input files via a cache hit.