3 ms·
interested. is the split for dedup, parallel pulls, or lazy loading specific files? maybe all. we've played with some chunking ideas on our end but haven't lan
by appcypher 4mo ago
interested. is the split for dedup, parallel pulls, or lazy loading specific files? maybe all.
we've played with some chunking ideas on our end but haven't landed on a format. drop a link when it's out.
- a_t48 4mo agoAll of the above, plus being able to reflink to skip copies of large files, plus not having to round trip from disk a few times for tar layers, plus a number of other side benefits. Only using lazy loading for buildkit right now, as it does require FUSE and I want it to be opt in (for robotics contexts, for instance, you never want to lazy load).