19 ms·
Which regular desktop tasks are kneecapped by 80GBps memory bandwidth?
by sangnoir 2y ago
Which regular desktop tasks are kneecapped by 80GBps memory bandwidth?
- marci 2y agoYou really start taking into account bandwidth when you need 64GB or more (which is rarelly). If it's audio/video, spawning VMs, it doesn't matter much. If it's for generative software, it might become an issue.
- mysteria 2y agoIf local LLMs become mainstream then you want as much memory bandwidth as possible. For regular home and office use two channels of DDR4 is more than enough.
- SSLy 2y agoUnironically, small LLMs
- sliken 2y agoLLMs and fast GPUs without having a giant PC spring to mind.