3 ms·
Memory throughput or memory capacity? Is that true for discrete GPUs like Nvidia? Is it the same for unified memory like the M-series?
by Tagbert 3y ago
Memory throughput or memory capacity?
Is that true for discrete GPUs like Nvidia?
Is it the same for unified memory like the M-series?
- api 3y agoBoth really, since models are pretty much 100% "hot" RAM. The bigger the model the more bandwidth it demands too since evaluating it means streaming the entire thing through the processor.