4 ms·
Coherency doesn't matter at all for a lot of cases. E.g. for inference, model weights are the vast majority of the memory use and are unchanging.
by mlyle 3y ago
Coherency doesn't matter at all for a lot of cases. E.g. for inference, model weights are the vast majority of the memory use and are unchanging.