4 ms·
My favorite microVM discovery recently has been tools built around libkrun. See smolvm[0]. The killer feature still missing from microVMs for me is the ability
by apitman 4mo ago
My favorite microVM discovery recently has been tools built around libkrun. See smolvm[0].
The killer feature still missing from microVMs for me is the ability to enable CUDA support without passing through the entire GPU. vfio is just too much of a pain and too limiting. Sometimes I want to use my GPU on the host. Vulkan works fairly well with virtio-gpu and Venus, but I need CUDA. Venus is also still missing some important things like accelerated video encoding.
[0]: https://smolmachines.com/ https://smolmachines.com/
- binsquare 4mo agoauthor of smolmachines here, CUDA support is possible based on a cursory dive. I'll keep you posted on it ref: https://thevirtualhorizon.com/2024/05/31/how-to-configure-the-nvidia-vgpu-drivers-cuda-toolkit-and-container-toolkit-on-debian-12/ https://thevirtualhorizon.com/2024/05/31/how-to-configure-th...
- apitman 4mo agoI think the main blocker is on nvidia's side, which is that vGPU is only available for enterprise customers/products.