3 ms·
Both really, since models are pretty much 100% "hot" RAM. The bigger the model the more bandwidth it demands too since evaluating it means streaming the entire
by api 3y ago
Both really, since models are pretty much 100% "hot" RAM. The bigger the model the more bandwidth it demands too since evaluating it means streaming the entire thing through the processor.