3 ms·
What's the usecase of 512 GB memory that you cannot achieve through multi GPUs? Maybe you can make it bit cheaper as you don't require multiple chip, but I woul
by YetAnotherNick 2y ago
What's the usecase of 512 GB memory that you cannot achieve through multi GPUs? Maybe you can make it bit cheaper as you don't require multiple chip, but I would say it is just a maybe because the chip is not the costliest part for Nvidia to manufacture, it is the memory[1].
[1]: https://www.nextplatform.com/2024/02/27/he-who-can-pay-top-dollar-for-hbm-memory-controls-ai-training/ https://www.nextplatform.com/2024/02/27/he-who-can-pay-top-d...
- immibis 2y agoOne card with twice the memory would let you run the model in half as many cards, at half the speed.