2 ms·
The size of CUDA really is astonishing. Any chance someone might figure out how to slim that down?
by simonw 3y ago
The size of CUDA really is astonishing. Any chance someone might figure out how to slim that down?
- dartos 3y agoNvidia is the only one who could, since they own it.
- xiphias2 3y agoTalking directly to the kernel / driver / firmware. As others have said, George Hotz is doing his best in reverse-engineering and skipping layers.
- jsheard 3y agoTaking a peek inside the package it seems to mostly be the libraries - CuFFT alone is about 350MB for example, twice over for the debug and release versions. I'm guessing those are probably fat binaries pre-compiled for every generation of Nvidia hardware rather than just the PTX bytecode, which would help to speed up fresh builds, at the expense of being huge.
- maille 3y agoRaise your voice on their forum: https://forums.developer.nvidia.com/t/how-to-overcome-the-huge-increase-of-windows-dlls-minimum-cuda-cudnn-builds-that-support-ampere/217580 https://forums.developer.nvidia.com/t/how-to-overcome-the-hu... Tried my luck 2 years ago but it keeps increasing.
- phdelightful 3y agoHere’s a blog that breaks down how large different pieces of CUDA are: https://carlpearson.net/post/20231023-cuda-releases/ https://carlpearson.net/post/20231023-cuda-releases/