3 ms·
Kinda Content marketing for another POSIX on S3 product, though I like the API interception vs FUSE approach. I'm curious how you get performance with object s
by siliconc0w 3y ago
Kinda Content marketing for another POSIX on S3 product, though I like the API interception vs FUSE approach. I'm curious how you get performance with object store latency without sacrifices unless you're intermediating. Other solutions typically run at least a fast metadata service.
- cuno 3y agoHi, author here. Yes, we've had to do a lot of things to deal with object storage latency. Since cunoFS is running inside a given process itself, it has greater visibility into what actions it can take and is likely to take. This means we can make huge improvements in our prediction logic, so that we can prefetch within and across files much better, thus hiding latencies. For POSIX metadata, we have a caching mechanism which is shared between processes, and we've invented a better way to encode this metadata so that it is retrieved alongside the LIST operation.