3 ms·
It doesn’t count most of the model, since it’s memory; it only shows up as memory used by the disk cache. Though if your machine can’t keep it all in memory, t
by Filligree 3y ago
It doesn’t count most of the model, since it’s memory; it only shows up as memory used by the disk cache.
Though if your machine can’t keep it all in memory, then speed will still fall off a cliff.
- trailbits 3y agoIf it is lazy loading just what it needs, seems like an efficient use of memory. In any case, this 4GB model will easily fit into the commenter's 16GB machine.
- astrange 3y agoIf you're running on GPU then it would need to be wired, and wired file-backed pages do count as process memory and have to physically fit in DRAM.