3 ms·
Very interesting, I was just exploring this to hopefully fit one of the latest quantized models in 16GB of VRAM.
by plqbfbv 10d ago
Very interesting, I was just exploring this to hopefully fit one of the latest quantized models in 16GB of VRAM.