4 ms·
Hi, author here. Yes, we've had to do a lot of things to deal with object storage latency. Since cunoFS is running inside a given process itself, it has greate
by cuno 3y ago
Hi, author here.
Yes, we've had to do a lot of things to deal with object storage latency. Since cunoFS is running inside a given process itself, it has greater visibility into what actions it can take and is likely to take. This means we can make huge improvements in our prediction logic, so that we can prefetch within and across files much better, thus hiding latencies. For POSIX metadata, we have a caching mechanism which is shared between processes, and we've invented a better way to encode this metadata so that it is retrieved alongside the LIST operation.