2 ms·
https://archive.is/xtXNB https://archive.is/xtXNB The title is very clickbaity. What's the memory bandwidth of one of these compared to a gpu? Why 16gb of "vra
by kristianp 3y ago
https://archive.is/xtXNB https://archive.is/xtXNB
The title is very clickbaity. What's the memory bandwidth of one of these compared to a gpu? Why 16gb of "vram"? Is that the limit of gpu accessible ram? What llm inference performance does it have?