3 ms·
I don't want to further this discussions but may be you dont realise some of the people who replied to you either design hardware for a living or has been in th
by ksec 2y ago
I don't want to further this discussions but may be you dont realise some of the people who replied to you either design hardware for a living or has been in the hardware industry for longer than 20 years.
- treprinum 2y agoFor some reason Apple did it with M3/M4 Max likely by folks that are also on HN. The question is how many of the years spent designing HW were spent also by educating oneselves on the latest best ways to do it.
- ksec 2y ago>For some reason..... They already replied with an answer.
- ryao 2y agoWhile it is not a GPU, Qualcomm already made an inferencing card with 128GB RAM: https://www.qualcomm.com/news/onq/2023/11/introducing-qualcomm-cloud-ai-100-ultra https://www.qualcomm.com/news/onq/2023/11/introducing-qualco... It would be interesting if those saying that a regular GPU with 128GB of VRAM cannot be made would explain how Qualcomm was able to make this card. It is not a big stretch to imagine a GPU with the same memory configuration. Note that Qualcomm did not use HBM for this.