3 ms·
You can’t just throw in more RAM without having the rest of the GPU architected for it. So there’s an R&D cost involved for such a design, and there may even be
by layer8 2y ago
You can’t just throw in more RAM without having the rest of the GPU architected for it. So there’s an R&D cost involved for such a design, and there may even be trade-offs on performance for the mass-market lower-tier models. I’m doubtful that the LLM enthusiast/tinkerer market is large enough for that to be obviously profitable.
- hajile 2y agoThat would depend on how they designed the memory controllers. GDDR6 only supporting 1-2gb modules at present (I believe GDDR6W supports 4gb modules). If they were using 12 1gb modules, then increasing to 24gb shouldn't be a very large change. Honestly, Apple seems to be on the right track here. DDR5 is slower than GDDR6, but you can scale the amount of RAM far higher simply by swapping out the density.
- KeplerBoy 2y agoIt's a 192 bit interface, so 6 16gbit chips.
- KeplerBoy 2y agoOf course you can just add more RAM. Double the capacity of every chip and you get twice the RAM without ever asking an engineer. People did it with the RTX3070. https://www.tomshardware.com/news/3070-16gb-mod https://www.tomshardware.com/news/3070-16gb-mod
- Tuna-Fish 2y agoCan you find me a 32Gbit GDDR6 chip?