4 ms·

> Threadripper is NOT a CPU for gaming. I run two gaming VMs for my kids on my Threadripper server.

by TwoNineA 6y ago

hu3 6y ago
I'd love to setup gaming VMs like that on a powerful server. Do you have a link on how to setup something like that?
- TwoNineA 6y ago
  https://mathiashueber.com/pci-passthrough-ubuntu-2004-virtual-machine/ https://mathiashueber.com/pci-passthrough-ubuntu-2004-virtua... I use NVidia video cards for VMs, AMD cards (other than BigNavi) have VM reboot issues.
  - MegaDeKay 6y ago
    Substantial progress on the AMD reset issue has been made recently. Many cards now reset properly and progress continues on those that aren't. No custom kernel required either. https://www.reddit.com/r/VFIO/comments/jturbd/vendorreset_new_project_to_help_amd_users_vfio/ https://www.reddit.com/r/VFIO/comments/jturbd/vendorreset_ne...
    - TwoNineA 6y ago
      I got really burned by AMD GPUs, had a 5700 XT for myself and rx 580 and 570 for my kids. None of them reset properly, had to build special kernel, and even sometimes then they just froze the host. Sold them all, got NVidia cards, never had issues since (7+ months).
simonh 6y ago
I don't think that fact that Threadripper is capable of running games makes it a "chip for gaming PCs", at least if that term is going to mean anything useful.
numlock86 6y ago
That doesn't make it a CPU for gaming, though.
deleted 6y ago
[deleted]
szundi 6y ago
I know a guy who does the same with a Raspberry Pi.
thrwyoilarticle 6y ago
What do you do for GPUs? 3 of them?
- Cyph0n 6y ago
  You can use just two GPUs if the host is running a virtualization manager like Proxmox. I currently run a Windows gaming VM and a bunch of Linux VMs on top of Proxmox using a single GPU. Planning to add a second GPU for transcoding in the near future.
- TwoNineA 6y ago
  Yup, el cheapo GT 710 for OS, and 970 GTX and 1050 Ti for gaming GPUs.
w0utert 6y ago
That's pretty cool! I run one gaming VM on my 3900X but I always wondered how well it would be able to handle 2 Win10 VM's playing games concurrently. Do all the other components of the solution (both hardware and software) scale well enough for that? I assume threadripper has enough PCIe lanes and IOMMU grouping that allows for 2 passthrough GPU's + 1 for the host?
- TwoNineA 6y ago
  Should handle gaming fine, you can even pin VMs on specific cores (I didn't bother). My kids play No Man's Sky with me and the 12 core 2920X handles it no issues whatsoever even though the game is atrocious optimization wise. Should have gotten a 16 core so we all three could play on same box. X<3|4|5>70 boards should allow 2 GPUs in separate IOMMU groups. My old system was a 1700X on ASUS Prime x370 Pro with 2 gaming VMs. Only issue with x?70 boards is the IOMMU groups for USB controllers. On the Prime x370 Pro, only one USB controller is in its own IOMMU group, so second VM needed a USB passthrough. On the Threadripper, due to the vast amount of PCIe lanes, on the Asrock Taichi x399, I got two USB controllers in their own IOMMU groups and each of the 4 PCIex16 slots it's in its own IOMMU group. It's a dream virtualization motherboard.
  - ericd 6y ago
    Is it possible to swap GPU assignments from the host OS to a guest OS and back, or does it require some motherboard-level/boot-time settings that make that difficult?
    - TwoNineA 6y ago
      Never tried, some people had success with NVidia GPUs. However, if you are willing to put your host in sleep and wake it up, then it should be much easier. Sleep usually resets the GPU and lets host drivers grab it.
  - w0utert 6y ago
    I should keep this in mind when I upgrade my workstation some time in the future. I have an x470 Taichi and there the IOMMU grouping is pretty bad, it also has only a single USB controller in its own group, and all PCIe slots except the top x16 one are grouped with other stuff so it's not even possible to plug in a separate USB controller card or a second GPU for passthrough. A ThreadRipper would have been a much better choice considering I also use this machine for development and can use all the cores I can get.

> Threadripper is NOT a CPU for gaming. I run two gaming VMs for my kids on my Threadripper server.

hu3 6y ago

I'd love to setup gaming VMs like that on a powerful server. Do you have a link on how to setup something like that?

TwoNineA 6y ago
https://mathiashueber.com/pci-passthrough-ubuntu-2004-virtual-machine/ https://mathiashueber.com/pci-passthrough-ubuntu-2004-virtua... I use NVidia video cards for VMs, AMD cards (other than BigNavi) have VM reboot issues.
- MegaDeKay 6y ago
  Substantial progress on the AMD reset issue has been made recently. Many cards now reset properly and progress continues on those that aren't. No custom kernel required either. https://www.reddit.com/r/VFIO/comments/jturbd/vendorreset_new_project_to_help_amd_users_vfio/ https://www.reddit.com/r/VFIO/comments/jturbd/vendorreset_ne...
  - TwoNineA 6y ago
    I got really burned by AMD GPUs, had a 5700 XT for myself and rx 580 and 570 for my kids. None of them reset properly, had to build special kernel, and even sometimes then they just froze the host. Sold them all, got NVidia cards, never had issues since (7+ months).

simonh 6y ago

I don't think that fact that Threadripper is capable of running games makes it a "chip for gaming PCs", at least if that term is going to mean anything useful.

numlock86 6y ago

That doesn't make it a CPU for gaming, though.

deleted 6y ago

[deleted]

szundi 6y ago

I know a guy who does the same with a Raspberry Pi.

thrwyoilarticle 6y ago

What do you do for GPUs? 3 of them?

Cyph0n 6y ago
You can use just two GPUs if the host is running a virtualization manager like Proxmox. I currently run a Windows gaming VM and a bunch of Linux VMs on top of Proxmox using a single GPU. Planning to add a second GPU for transcoding in the near future.
TwoNineA 6y ago
Yup, el cheapo GT 710 for OS, and 970 GTX and 1050 Ti for gaming GPUs.

w0utert 6y ago

That's pretty cool! I run one gaming VM on my 3900X but I always wondered how well it would be able to handle 2 Win10 VM's playing games concurrently. Do all the other components of the solution (both hardware and software) scale well enough for that? I assume threadripper has enough PCIe lanes and IOMMU grouping that allows for 2 passthrough GPU's + 1 for the host?

TwoNineA 6y ago
Should handle gaming fine, you can even pin VMs on specific cores (I didn't bother). My kids play No Man's Sky with me and the 12 core 2920X handles it no issues whatsoever even though the game is atrocious optimization wise. Should have gotten a 16 core so we all three could play on same box. X<3|4|5>70 boards should allow 2 GPUs in separate IOMMU groups. My old system was a 1700X on ASUS Prime x370 Pro with 2 gaming VMs. Only issue with x?70 boards is the IOMMU groups for USB controllers. On the Prime x370 Pro, only one USB controller is in its own IOMMU group, so second VM needed a USB passthrough. On the Threadripper, due to the vast amount of PCIe lanes, on the Asrock Taichi x399, I got two USB controllers in their own IOMMU groups and each of the 4 PCIex16 slots it's in its own IOMMU group. It's a dream virtualization motherboard.
- ericd 6y ago
  Is it possible to swap GPU assignments from the host OS to a guest OS and back, or does it require some motherboard-level/boot-time settings that make that difficult?
  - TwoNineA 6y ago
    Never tried, some people had success with NVidia GPUs. However, if you are willing to put your host in sleep and wake it up, then it should be much easier. Sleep usually resets the GPU and lets host drivers grab it.
- w0utert 6y ago
  I should keep this in mind when I upgrade my workstation some time in the future. I have an x470 Taichi and there the IOMMU grouping is pretty bad, it also has only a single USB controller in its own group, and all PCIe slots except the top x16 one are grouped with other stuff so it's not even possible to plug in a separate USB controller card or a second GPU for passthrough. A ThreadRipper would have been a much better choice considering I also use this machine for development and can use all the cores I can get.