This is kind of already available for VDI if your willing to accept the overhead of multiple OS instance. Nvidia GRID and similar GPU / Compute boards can handl

This is kind of already available for VDI if your willing to accept the overhead of multiple OS instance. Nvidia GRID and similar GPU / Compute boards can handle multiple simultaneous users. The problem is COST. These are designed for VDI servers supporting 25/50/100 desktop users not 1 gamer and are priced as enterprise equipment.