Some older Tesla products were separate boxes: http://www.nvidia.in/object/product-tesla-S2050-in.html http://www.nvidia.in/object/product-tesla-S2050-in.html

Some older Tesla products were separate boxes: http://www.nvidia.in/object/product-tesla-S2050-in.html http://www.nvidia.in/object/product-tesla-S2050-in.html The form factor isn't a choice... The cards have a lot of stuff on them that need to go somewhere. For applications that need it, single servers can fit 8 GPUs these days. As for why they're still "GPUs"; there is nothing particularly "central" about modern CPUs either. One could argue that neural networks are a form of "graph" though.