4 ms·
What do you mean you were even able to make it work? It works out of the box with no configuration.
by whatever1 2y ago
What do you mean you were even able to make it work? It works out of the box with no configuration.
- caspper69 2y agoCan't speak for CUDA specifically, because I don't do anything with LLMs or ML locally, but I did have to rebuild ffmpeg with some some bits built with nvcc (and maybe an nvidia provided library- sorry it's been a while) to get GPU accelerated transcoding going. But yes, the GPU passthrough layer in WSL2 (or however it's actually implemented) is present by default.
- umvi 2y agoI meant compared to other Linux/Windows coexistence tools I've used in the past where GPU passthrough was a huge challenge