There are HPC GPU centric servers with ARM CPUs and NVIDIA GPUs on the market https://www.hpcwire.com/off-the-wire/oss-introduces-solution-incorporating-nvidia-

There are HPC GPU centric servers with ARM CPUs and NVIDIA GPUs on the market https://www.hpcwire.com/off-the-wire/oss-introduces-solution-incorporating-nvidia-gpus-with-nvlink-and-marvell-thunderx2-arm-based-servers/ https://www.hpcwire.com/off-the-wire/oss-introduces-solution... It actually makes quite a bit of sense more so than buying Intel/AMD CPUs if you think about it. The CPU does little to nothing in those machines using a bespoke ARM design will allow you to have as many PCIe lanes as your heart desires and also optimize other things such as memory access to make those solutions even more optimal than using off the shelf general purpose server platforms.