4 ms·

What does it do? Does it let one pass a virtual GPU to the guest without complete PCI-passthrough? E.g. will I be able to share host GPU between the host system

What does it do? Does it let one pass a virtual GPU to the guest without complete PCI-passthrough? E.g. will I be able to share host GPU between the host system and guests?

ArcVRArthur 4y ago
Ya, that's exactly correct. :)
- Melatonic 4y ago
  What about one GPU with multiple VM? Annoying t hing right now is that you have to pony up for the fancy nvidia cards plus insane nvidia licensing for their multiGPU virtualized cards. AMD at least makes you only pay for the hardware but its still super pricey.
  - ArcVRArthur 4y ago
    Ya, you can use multiple VMs. Here is a video I took of a laptop with LibVF.IO and an early pre-release version of GVM installed - at the start of the video you can see a fullscreen Windows VM and then I back out and open another compartmentalized 'app VM' (browser): https://streamable.com/gd45bh https://streamable.com/gd45bh Both VMs are actually based on Windows (one simply doesn't have explorer.exe running) and each has it's own virtual GPU attached. This laptop has a Nvidia graphics processor inside but it also works with laptops that have an Xe Intel graphics processor. I'm hoping at some point it will work well on AMD too.
    - lostmsu 4y ago
      Can I run CUDA in the guest OS (Windows)?
    - kbumsik 4y ago
      Sounds very interesting! Do VMs work with a display session (Xorg) too? Some GPU-enabled applications require an X server with a physical HDMI/Displayport attached.
      - ArcVRArthur 4y ago
        Ya! You can use VMs that use X11 in the guest without issue. X11 also works on the host. Wayland is also working on the host - I haven't tested yet with Wayland guests yet so that's something to try.
amelius 4y ago
How secure is that? Are users of a GPU completely isolated from eachother? Will there be side-channel attacks possible?
- amarshall 4y ago
  It’s mostly up to the specific hardware and its host-side drivers. I’d say that GPU compute security is a very under-studied area compared with CPU compute.
  - ArcVRArthur 4y ago
    Ya, that's accurate. The precise driver implementation matters a lot. Having said that there are some good 'best practices' that seem to make a difference. In my opinion 'IOMMU Aware Mediated Device' could also make some much needed improvements here as it would allow for more granular IOMMU allocations - perhaps this mode could help further support the 'App VMs' use-case using shared work queues without breaking IO virtual address translation: https://lwn.net/ml/linux-kernel/20190222021927.13132-1-baolu.lu@linux.intel.com/ https://lwn.net/ml/linux-kernel/20190222021927.13132-1-baolu...
- ArcVRArthur 4y ago
  GVM uses IOMMU for compartmentalization: This page has a comparison of the various IO assistance modes GVM can make use of (see comparison of assistance modes, the Mdev Mode section, and the SR-IOV Mode section): https://openmdev.io/index.php/Virtual_IO_Internals https://openmdev.io/index.php/Virtual_IO_Internals This will probably also play a role in future developments like SIOV (Scalable IO Virtualization): https://lwn.net/ml/linux-kernel/20190222021927.13132-1-baolu.lu@linux.intel.com/ https://lwn.net/ml/linux-kernel/20190222021927.13132-1-baolu...

What does it do? Does it let one pass a virtual GPU to the guest without complete PCI-passthrough? E.g. will I be able to share host GPU between the host system and guests?

ArcVRArthur 4y ago

Ya, that's exactly correct. :)

Melatonic 4y ago
What about one GPU with multiple VM? Annoying t hing right now is that you have to pony up for the fancy nvidia cards plus insane nvidia licensing for their multiGPU virtualized cards. AMD at least makes you only pay for the hardware but its still super pricey.
- ArcVRArthur 4y ago
  Ya, you can use multiple VMs. Here is a video I took of a laptop with LibVF.IO and an early pre-release version of GVM installed - at the start of the video you can see a fullscreen Windows VM and then I back out and open another compartmentalized 'app VM' (browser): https://streamable.com/gd45bh https://streamable.com/gd45bh Both VMs are actually based on Windows (one simply doesn't have explorer.exe running) and each has it's own virtual GPU attached. This laptop has a Nvidia graphics processor inside but it also works with laptops that have an Xe Intel graphics processor. I'm hoping at some point it will work well on AMD too.
  - lostmsu 4y ago
    Can I run CUDA in the guest OS (Windows)?
  - kbumsik 4y ago
    Sounds very interesting! Do VMs work with a display session (Xorg) too? Some GPU-enabled applications require an X server with a physical HDMI/Displayport attached.
    - ArcVRArthur 4y ago
      Ya! You can use VMs that use X11 in the guest without issue. X11 also works on the host. Wayland is also working on the host - I haven't tested yet with Wayland guests yet so that's something to try.

amelius 4y ago

How secure is that? Are users of a GPU completely isolated from eachother? Will there be side-channel attacks possible?

amarshall 4y ago
It’s mostly up to the specific hardware and its host-side drivers. I’d say that GPU compute security is a very under-studied area compared with CPU compute.
- ArcVRArthur 4y ago
  Ya, that's accurate. The precise driver implementation matters a lot. Having said that there are some good 'best practices' that seem to make a difference. In my opinion 'IOMMU Aware Mediated Device' could also make some much needed improvements here as it would allow for more granular IOMMU allocations - perhaps this mode could help further support the 'App VMs' use-case using shared work queues without breaking IO virtual address translation: https://lwn.net/ml/linux-kernel/20190222021927.13132-1-baolu.lu@linux.intel.com/ https://lwn.net/ml/linux-kernel/20190222021927.13132-1-baolu...
ArcVRArthur 4y ago
GVM uses IOMMU for compartmentalization: This page has a comparison of the various IO assistance modes GVM can make use of (see comparison of assistance modes, the Mdev Mode section, and the SR-IOV Mode section): https://openmdev.io/index.php/Virtual_IO_Internals https://openmdev.io/index.php/Virtual_IO_Internals This will probably also play a role in future developments like SIOV (Scalable IO Virtualization): https://lwn.net/ml/linux-kernel/20190222021927.13132-1-baolu.lu@linux.intel.com/ https://lwn.net/ml/linux-kernel/20190222021927.13132-1-baolu...