In fact, Qualcomm has announced a "Cloud AI" PCIe card designed for inference (as opposed to training & inference) [1, 2]. It's populated with NSPs like the on

In fact, Qualcomm has announced a "Cloud AI" PCIe card designed for inference (as opposed to training & inference) [1, 2]. It's populated with NSPs like the ones in mobile SoCs. [1] https://www.qualcomm.com/products/technology/processors/cloud-artificial-intelligence/cloud-ai-100 https://www.qualcomm.com/products/technology/processors/clou... [2] https://github.com/quic/software-kit-for-qualcomm-cloud-ai-100-cc https://github.com/quic/software-kit-for-qualcomm-cloud-ai-1...