While it is not a GPU, Qualcomm already made an inferencing card with 128GB RAM: https://www.qualcomm.com/news/onq/2023/11/introducing-qualcomm-cloud-ai-100-ul

While it is not a GPU, Qualcomm already made an inferencing card with 128GB RAM: https://www.qualcomm.com/news/onq/2023/11/introducing-qualcomm-cloud-ai-100-ultra https://www.qualcomm.com/news/onq/2023/11/introducing-qualco... It would be interesting if those saying that a regular GPU with 128GB of VRAM cannot be made would explain how Qualcomm was able to make this card. It is not a big stretch to imagine a GPU with the same memory configuration. Note that Qualcomm did not use HBM for this.