4 ms·
SanDisk's New High Bandwidth Flash Memory Enables 4TB of VRAM on GPUs
- deleted 2y ago[deleted]
- dummydummy1234 2y agoSo, what is the bandwidth? What is the bandwidth once the cache is reached.
- layla5alive 2y agoThe lack of write endurance on these would make these chips throwaway after some amount of use. As much as the performance characteristics would be excellent, I really hope we don't go down the path of building GPU ASICs which will eventually totally cease to function when their NAND arrays fail. I'd hope they would then fall back to functioning without NAND, but there's almost no chance modern corporations would care about supporting their ability to function after that happens... if we do this, parts of computing history will be very difficult to preserve long term. And I know Apple is already doing this. sigh.
- trillic 2y agoStoring model weights for inference wouldn’t be writing much.
- throwaway81523 2y agoMaybe Optane got discontinued too early.