5 ms·
107MB of cPython defeated Go to try for self Step 1 download 2.4GB of CUDA
by QuadmasterXLII 3y ago
107MB of cPython defeated
Go to try for self
Step 1 download 2.4GB of CUDA
- deleted 3y ago[deleted]
- simonw 3y agoThe size of CUDA really is astonishing. Any chance someone might figure out how to slim that down?
- dartos 3y agoNvidia is the only one who could, since they own it.
- xiphias2 3y agoTalking directly to the kernel / driver / firmware. As others have said, George Hotz is doing his best in reverse-engineering and skipping layers.
- jsheard 3y agoTaking a peek inside the package it seems to mostly be the libraries - CuFFT alone is about 350MB for example, twice over for the debug and release versions. I'm guessing those are probably fat binaries pre-compiled for every generation of Nvidia hardware rather than just the PTX bytecode, which would help to speed up fresh builds, at the expense of being huge.
- maille 3y agoRaise your voice on their forum: https://forums.developer.nvidia.com/t/how-to-overcome-the-huge-increase-of-windows-dlls-minimum-cuda-cudnn-builds-that-support-ampere/217580 https://forums.developer.nvidia.com/t/how-to-overcome-the-hu... Tried my luck 2 years ago but it keeps increasing.
- phdelightful 3y agoHere’s a blog that breaks down how large different pieces of CUDA are: https://carlpearson.net/post/20231023-cuda-releases/ https://carlpearson.net/post/20231023-cuda-releases/
- gcr 3y agoI mean, being fair, the 2.4GB CUDA SDK is absolutely required for the cPython implementation as well
- dwroberts 3y agoA bunch of install methods for torch via pip include ~1.5GB of lib/ because of CUDA. libtorch_cuda.so is like 800MB on its own
- fsloth 3y agoI don't think it's about the byte size, but the inherent complexity of the implementation. 1000 lines of C code is extremely simple by any standard. Whereas a sundry collection of Python and PyTorch libraries is anything but.