wofo

11 ms·

121.
by wofo 2y ago
I tried using that API directly, but it unfortunately did require ordered uploads too :')
122.
by wofo 2y ago
Yep, I originally thought that wouldn't work... But now I discovered (thanks to a comment here) that the registry is allowed to return an HTTP redirect instead of serving the layer blobs directly... Which opens new possibilities :)
123.
by wofo 2y ago
To be clear, the 8x was comparing the slowest ECR throughput measurement against the fastest S3 one. In any case, the improvement is significant.
124.
by wofo 2y ago
Unfortunately, all the code is proprietary at the moment. If you are willing to get your hands dirty, the main thing to realize is that container layers are "just" tar files (see, for instance, this article: https://och
125.
by wofo 2y ago
Indeed, they could support it through a non-standard API... I wish they did!
126.
by wofo 2y ago
Ah, that's great! I'll have to look into it :)
127.
by wofo 2y ago
I didn't expect that! It's a pity they don't expose an API for parallel uploads, for those of us who need to maximize throughput and don't mind using something non-standard.
128.
by wofo 2y ago
That's true, unfortunately. I'm thinking about ways to somehow support private repos without introducing a proxy in between... Not sure if it will be possible.
129.
by wofo 2y ago
The source code is proprietary, but it shouldn't take much work to replicate, fortunately (you just need to upload files at the right paths).
130.
by wofo 2y ago
Indeed, you are free to push multiple layers in parallel. But when you have a 1 GiB layer full of AI/ML stuff you can feel the pain! (I just updated my original comment to make clear I'm talking about single-layer pushes here)
131.
by wofo 2y ago
Layers are fully independent of each other in the OCI spec (which makes them reusable). They are wired together through a separate manifest file that lists the layers of a specific image. It's a mystery... Here are the bits of the OCI
132.
by wofo 2y ago
That's true, but I'd assume the server would like to double-check that the hashes are valid (for robustness / consistency)... That's something my little experiment doesn't do, obviously.
133.
by wofo 2y ago
I wonder whether the folks at Cloudflare could take the ideas from the blog post and create a high-performance serverless container registry based on R2. They could call it scrubs, for "serverless container registry using blob storage&
134.
by wofo 2y ago
Other than backwards-compatibility, I can imagine simplicity being a reason. For instance, sequential pushing makes it easier to calculate the sha256 hash of the layer as it's being uploaded, without having to do it after-the-fact when
135.
by wofo 2y ago
No idea... I asked the same question here ( https://news.ycombinator.com/item?id=40943480 ) and am hoping we'll have a classic HN moment where someone who was involved in the design of the spec will chime in.
136.
by wofo 2y ago
Hi HN, author here. If anyone knows why layer pushes need to be sequential in the OCI specification, please tell! Is it merely a historical accident, or is there some hidden rationale behind it? Edit: to clarify, I'm talking about sequ
137.
Inspect TLS encrypted traffic using mitmproxy and Wireshark(koyeb.com)
39 points by wofo 2y ago|5 comments
138.
Waiter, there's a whale in my bucket(ochagavia.nl)
2 points by wofo 2y ago|0 comments
139.
LINQPad – The .NET Programmer's Playground(linqpad.net)
308 points by wofo 2y ago|130 comments
140.
Download Accelerator – Async Rust Edition(ochagavia.nl)
9 points by wofo 2y ago|3 comments
141.
QUIC's (Hidden) Super Powers(quic.video)
2 points by wofo 2y ago|0 comments
142.
Timeliness without datagrams using QUIC(quic.video)
224 points by wofo 2y ago|209 comments
143.
Chasing a Bug in a SAT Solver(ochagavia.nl)
75 points by wofo 2y ago|31 comments
144.
Red Bean Software(red-bean.com)
4 points by wofo 2y ago|1 comments
145.
The Name Quest(blog.orhun.dev)
1 points by wofo 2y ago|0 comments
146.
Download Accelerator – Async Rust Edition(ochagavia.nl)
1 points by wofo 2y ago|0 comments
147.
Foray into Fourier(roughly-understood.com)
9 points by wofo 2y ago|1 comments
148.
A Linker in the Wild [video](youtube.com)
2 points by wofo 2y ago|0 comments
149.
A Readout from Tectonics(memorysafety.org)
2 points by wofo 2y ago|0 comments
150.
The Joys of the Craft(ochagavia.nl)
2 points by wofo 2y ago|1 comments

More ›