This is a very valid point. Adding 100ms of latency to games that already struggle to deal with their built in ~100-150ms already is basically a non-starter. So

This is a very valid point. Adding 100ms of latency to games that already struggle to deal with their built in ~100-150ms already is basically a non-starter. So you're left with casual games, single player games (with no modding), and maybe some less latency sensitive multi-player games.