4 ms·
It's slower than the 4:1 ratio would imply, but it does indeed work. Things get really slow if the model doesn't for in vram + ram and you have to go from disk
by buckle8017 3mo ago
It's slower than the 4:1 ratio would imply, but it does indeed work.
Things get really slow if the model doesn't for in vram + ram and you have to go from disk to ram to vram.