2 ms·
Again, memory bandwidth is pretty much all that matters here. During inference or training the CUDA cores of retail GPUs are like 15% utilized.
by adastra22 11mo ago
Again, memory bandwidth is pretty much all that matters here. During inference or training the CUDA cores of retail GPUs are like 15% utilized.
- deleted 11mo ago[deleted]
- my123 11mo agoNot for prompt processing. Current Macs are really not great at long contexts