3 ms·

I don't mind packages being installed sequentially, but I do wish they would be downloaded in parallel. It's very annoying to watch ~1500 packages, most of whic

I don't mind packages being installed sequentially, but I do wish they would be downloaded in parallel. It's very annoying to watch ~1500 packages, most of which are only a few KiB in size, download at the rate of one per second on a gigabit connection. (I'm on openSUSE, so zypper. I think yum downloads in parallel now after dnf improvements were merged into it?)

deleted 7y ago
[deleted]
mehrdadn 7y ago
powerpill and apt-fast are handy for this, though they should really do this by default, yeah.
throwaway8941 7y ago
dnf does download the packages in parallel. You can configure the degree of parallelism in `dnf.conf`. Look for `max_parallel_downloads` here: https://dnf.readthedocs.io/en/latest/conf_ref.html https://dnf.readthedocs.io/en/latest/conf_ref.html
orev 7y ago
I think this is done more for the sake of the server sending the files, not the client side. Most Linux distros are using some form of donated mirror servers, and it’s not nice to slam them with requests.
- Arnavion 7y ago
  That probably was the reason when package managers were invented. I don't think it makes sense today, especially when we do have some package managers downloading in parallel (like dnf as I mentioned). That means at least some distros believe their infrastructure can handle it. As for volunteer servers, if a particular server can't handle >N connections, it can drop them. No reason to gimp clients instead. And specifically in openSUSE's case, nobody has put forth server bandwidth / limits as a reason not to parallelize downloads. [1][2][3] It's just not been done because nobody (including myself) has cared enough to figure out how to do it. [1]: https://features.opensuse.org/307862 https://features.opensuse.org/307862 [2]: https://github.com/openSUSE/zypper/issues/104 https://github.com/openSUSE/zypper/issues/104 [3]: https://github.com/openSUSE/zypper/issues/160 https://github.com/openSUSE/zypper/issues/160

deleted 7y ago

[deleted]

mehrdadn 7y ago

powerpill and apt-fast are handy for this, though they should really do this by default, yeah.

throwaway8941 7y ago

dnf does download the packages in parallel. You can configure the degree of parallelism in `dnf.conf`. Look for `max_parallel_downloads` here: https://dnf.readthedocs.io/en/latest/conf_ref.html https://dnf.readthedocs.io/en/latest/conf_ref.html

orev 7y ago

I think this is done more for the sake of the server sending the files, not the client side. Most Linux distros are using some form of donated mirror servers, and it’s not nice to slam them with requests.

Arnavion 7y ago
That probably was the reason when package managers were invented. I don't think it makes sense today, especially when we do have some package managers downloading in parallel (like dnf as I mentioned). That means at least some distros believe their infrastructure can handle it. As for volunteer servers, if a particular server can't handle >N connections, it can drop them. No reason to gimp clients instead. And specifically in openSUSE's case, nobody has put forth server bandwidth / limits as a reason not to parallelize downloads. [1][2][3] It's just not been done because nobody (including myself) has cared enough to figure out how to do it. [1]: https://features.opensuse.org/307862 https://features.opensuse.org/307862 [2]: https://github.com/openSUSE/zypper/issues/104 https://github.com/openSUSE/zypper/issues/104 [3]: https://github.com/openSUSE/zypper/issues/160 https://github.com/openSUSE/zypper/issues/160