3 ms·

I am guessing that it would be possible to download the model from HuggingFace in the build step. I'm not sure though. Plus the Cog image is 14GB in size (menti

I am guessing that it would be possible to download the model from HuggingFace in the build step. I'm not sure though. Plus the Cog image is 14GB in size (mentioned in the article), I hope there's a way to reduce that.

Szpadel 3y ago
Sure, but I'm still do not understand why multi-stage should make any difference, because at the end it's just flattened as layer from copy between stages. So the problem of size is exactly the same, and RUN with curl will have identical size as COPY layer from COPY --from=stage Am I missing something? I can see only benefit for build cache reuse, so download is independed from building code so you won't redownload 14G when you change code, is that what you had in mind?
- timenova 3y ago
  You're right! Thanks for pointing this out. I don't know Docker that well. I literally figured it out as I went along to deploy on Fly...
  - Szpadel 3y ago
    No problem. I didn't wanted to sound snarky, I thought that I wasn't aware about some cool docker optimization hack :)
simonw 3y ago
Fly recommend you use one of their mountable volumes for large model files rather than building it into the Docker image - you get faster cold starts that way, plus I think the images have size limits.