6 ms·
Stupid question: are GPU safe to be shared by two tenants in a datacenter? I read previously that there are very few security mechanisms in GPU, in particular t
by cm2187 10y ago
Stupid question: are GPU safe to be shared by two tenants in a datacenter? I read previously that there are very few security mechanisms in GPU, in particular that the memory is full of interesting garbage. So I would assume no hardware enforced separation between the VMs too.
- moonbug 10y agoThe GPUs aren't shared between VMs, each GPU is dedicated to the VM it is allocated to. The GPU memory gets wiped on initialisation, just like host memory, so there's no leakage between successive VMs allocated the same hardware. If you do absolutely care about not being multitennanted, you can stipulate exclusive hw allocation when requesting the VM.
- _pmf_ 10y ago> The GPU memory gets wiped on initialisation Well, an attempt is made. As we can see in the case of WebGL, there are a multitude of interesting effects.
- moonbug 10y agoCan't speak to what happens on a Windows box, but across AWS instances it's definitely the case.
- jon-wood 10y agoAt the sort of scale these instances run I'd be surprised if you're sharing any physical hardware at all, my guess is that they provision a single VM on each GPU instance.
- boulos 10y agoThat's not mentioned in the article, did you work on this? Disclosure: I work on Google Cloud.
- corysama 10y agoNvidia has been doing a lot of work on hardware virtualization of GPUs. A goal of which is to run dozens of low-requirements desktops (think users running MS Office in separate Windows VMs) off of a single high-end server with a single GPU. http://www.nvidia.com/object/grid-technology.html http://www.nvidia.com/object/grid-technology.html