You could consider using https://github.com/spack/spack https://github.com/spack/spack and build python packages + binaries from sources optimized for your part

You could consider using https://github.com/spack/spack https://github.com/spack/spack and build python packages + binaries from sources optimized for your particular microarchitecture. Clearly there are no sources for cuda itself, but they are downloaded from the nvidia website or a mirror. Also NVIDIA could consider breaking up their packages into smaller pieces. But then again, they're still doing better than Intel, which ships 15GB+ images for their OneAPI