> how do Google Cloud and EC2 attach GPUs to instances - given that you can choose CPU and RAM the GPUs must somehow be modularized away from a dedicated server

> how do Google Cloud and EC2 attach GPUs to instances - given that you can choose CPU and RAM the GPUs must somehow be modularized away from a dedicated server? Rack A of servers has a base_server_x. Rack B of servers is base_server_x + GPU_Y. You ask for no GPU, you get a server from rack A. You ask for a GPU, you get a server from rack B. No magic monkey adding GPUs to instances ;)