5 ms·

Not aware of the docker image in question, but a docker image starts empty (0 bytes). A full operating system (Ubuntu 20.04) base is is 75MB. You can probably

Not aware of the docker image in question, but a docker image starts empty (0 bytes). A full operating system (Ubuntu 20.04) base is is 75MB. You can probably slim that down a bit if you needed, but installing your software on top might only take a few MB. So cutting chrome down from 60MB could well be a good goal.

nikisweeting 6y ago
Unfortunately our image is ~450MB right now because we have install both Python and JS, Chrome, fonts, vido codecs, and a bunch of other software for all the extractors. Most of it is from this killer 266MB line, but unfortunately we need all these things: apt-get update -qq && \ apt-get install -qq -y --no-install-recommends \ wget curl chromium git ffmpeg youtube-dl \ fontconfig fonts-ipafont-gothic fonts-wqy-zenhei fonts-thai-tlwg fonts-kacst fonts-symbola fonts-noto fonts-freefont-ttf && \ rm -rf /var/lib/apt/lists/* https://hub.docker.com/layers/nikisweeting/archivebox/latest/images/sha256-50c2ce319243c72124f29132ccb45410e64ec3c8ce6cab50a91160687a406358?context=explore https://hub.docker.com/layers/nikisweeting/archivebox/latest... Any 10MB here or there will help, whether it's from Chrome core or something else. If you have any suggestions I'm all ears!
- dflock 6y ago
  Maybe give this a try: https://github.com/docker-slim/docker-slim https://github.com/docker-slim/docker-slim
- graderjs 6y ago
  Yeah the fonts take alot. Why do you need to slim the images down? Do you really need the fonts present to archive the content, I thought you were saving the HTML, wouldn't these fonts just be needed to render?
  - nikisweeting 6y ago
    The fonts are for PDF and screenshot rendering.
    - graderjs 6y ago
      Have you considered doing the install at usage time? If you're trying to save on bandwidth of downloaded images....
      - nikisweeting 6y ago
        Doesn't help, they're used almost immediately.

nikisweeting 6y ago

Unfortunately our image is ~450MB right now because we have install both Python and JS, Chrome, fonts, vido codecs, and a bunch of other software for all the extractors. Most of it is from this killer 266MB line, but unfortunately we need all these things: apt-get update -qq && \ apt-get install -qq -y --no-install-recommends \ wget curl chromium git ffmpeg youtube-dl \ fontconfig fonts-ipafont-gothic fonts-wqy-zenhei fonts-thai-tlwg fonts-kacst fonts-symbola fonts-noto fonts-freefont-ttf && \ rm -rf /var/lib/apt/lists/* https://hub.docker.com/layers/nikisweeting/archivebox/latest/images/sha256-50c2ce319243c72124f29132ccb45410e64ec3c8ce6cab50a91160687a406358?context=explore https://hub.docker.com/layers/nikisweeting/archivebox/latest... Any 10MB here or there will help, whether it's from Chrome core or something else. If you have any suggestions I'm all ears!

dflock 6y ago
Maybe give this a try: https://github.com/docker-slim/docker-slim https://github.com/docker-slim/docker-slim
graderjs 6y ago
Yeah the fonts take alot. Why do you need to slim the images down? Do you really need the fonts present to archive the content, I thought you were saving the HTML, wouldn't these fonts just be needed to render?
- nikisweeting 6y ago
  The fonts are for PDF and screenshot rendering.
  - graderjs 6y ago
    Have you considered doing the install at usage time? If you're trying to save on bandwidth of downloaded images....
    - nikisweeting 6y ago
      Doesn't help, they're used almost immediately.